One of the reasons we know the universe had to have been much smaller and closer together in the past is that to have that uniform temperature over such a large scale (the entire cmb) those parts needed to be close together at some point to "coordinate" on what temperature they should all be.