Worth emphasizing your second paragraph: East and West are not defined by the sun rising and setting. That would be a very silly idea. They're perpendicular to North and South because they're defined as perpendicular to North and South.