It sounds like you're imagining "expansion" to be some outward expansion from a point in space, rather than spacetime expanding everywhere. There's no reason to tie the age of the universe to its size (other than just how its size changes proportionally, relative to itself with time). It could have been any size prior to inflation. The fact that the observable universe is larger in lightyears than the age of the universe in years is not surprising or particularly meaningful.