If you had kept walking up Elm Street past the Shops, you would have arrived at the historic New Haven Green, with easy access to Yale's Old Campus and Cross Campus, both of which are accessible by the public. You also could have seen quite a bit more little nooks and crannies of Yale's campus. It's not a gated compound, it's an urban campus that's pretty well integrated into the surrounding city center.