Well if your assertion was true then spacetime would have near total symmetry & only our perception would make the difference.

Because, since in a collapsing universe time would then run in reverse & that looks like an expanding universe to any perception that relies on entropic increase.

But since we cannot presently model entropically negative perceptions then the question becomes a truism.