You start looking north when you orient yourself using a map. North may not necessarily be "up" but it is forward. North was determined by a combination of Polaris and compass direction. So, 2 reasons right there. Same concept of why clocks turn clockwise, sundials.