Completely depends on time period and which culture and society you’re looking at. In antiquity, cavalry forces in Europe and the Middle East mainly consisted of nobles because they were the only ones that could afford their own horse. At the same time, there were nomadic tribes in the steppes where everyone had a horse because it was easier to raise animals than farm the land there.

So yeah it just depends on when and where.