Because it's not sport, it's an action sequence for Harry, packaged into sports flair. That's why the rules make no sense, and why it's needlessly dangerous (as half the stuff in that school). It's the way Harry can be Luke Skywalker for a minute