The plane will never dive at such an angle that the mask will swing all the way to the person in front of you.. If it is, you and the person in front of you are going to be too scared to grab the mask anyway.

Additionally, the masks are on a short tether when initially deployed. A tether too short to swing to the passenger in front. Theres the hose you see in the safety briefing thats long, but then an additional string attached from the mask to a pin that has to be pulled in order to start the chemical reaction in the O2 container. The reason it's so short is so you're forced to pull that pin out in the process of putting the mask on. Otherwise you would have to be instructed to pull the pin, which most people would forget in their panic.

So its extremely unlikely the person in front of you will even have the chance to grab the mask.