Question

which way does a column go

Answer 1

a column is going from top to bottom

Answer 2

It is vertical. A way to tell the difference is this:
Member that horizontal comes from the word "horizon" , so that means that vertical is straight up, as in like the wall. 
Hope I helped you understand this concept. :)