Interesting point because humans are not particularly sexually dimorphic when compared to other animals, and even other primates. Sexual selection is often overlooked in evolution, but females play a large role in what traits are conserved and which are lost. For humans, parental involvement was favored over size/strength of males. This is why we pair-bond and are mostly monogamous with fewer offspring.