> objects at the far edges of the universe are actually travelling at constant velocity from their reference

That's the neat trick - they are not traveling at all! Expansion of Universe is happening because space between everything is growing, not because something is flying away.

Closest analogue would be - draw two points on a balloon and start inflating it. Distance between this two points would start to increase without them moving by themselves.