Yep. That's because the things weren't getting distant inside space-time, but space-time itself was expanding between things. Relativity only puts a cap on the speed things move inside time-space, not the rate that time-space itself grows

But the universe IS the surface. In this example, there is no inside. For an object placed upon the baloon, all that he sees is everything getting further apart, and that's how the universe behaves.

The universe was smaller, than it got bigger. It got bigger everywhere, in all directions, at the same rate. There is no 'X' direction where things got pushed out of, everything just got more distant from everything else.

A ballon's surface doesn't have a center. If you inflate it, its area will grow at the same rate everywhere. You can put a point in any place of a sphere's surface and none of them will be the center, that's how it goes with the universe too, as far as I know.

So the big bang is basically that, it was a smaller area, maybe infinitesimaly smaller area, that just got bigger everywhere. Everything was just farther apart. There was no center before, there isn't one now, just like a inflated sphere surface.

There is no X. Things didn't get ejected, everything was extremely close to everything else, and of a sudden they started to get far away from everything else. It's like the surface of a baloon, if you inflate it, everything is further apart, there is no "point of ejection" on the surface.