It’s because position is determined by polling. Yeah, giving a “lesser” team a shot could mean an upset but that’s what makes sports great. A wild card race in college football would be a nightmare for establishment conferences like the SEC that depend on having a BIG10 challenger to wail on in the championship game.