It isn’t right, there’s quite a few stadiums that are just in or outside the town/city centres in the UK. Maybe right if you literally mean a few streets off the high street: The vast majority would be within the 5 mile range on this infographic aside from the odd stadium built within the last 10/20 years.