>and raised by a different family then maybe it would be the equivalent of a completely different person and consciousness (basically the same as if a different baby was born).

Consciousness remains the same in whatever body you observe it. What does differ is the conditioned individual, AKA the ego. And you're absolutely right, the conditioned individual is completely unreal. And your example is apt for demonstrating this. If Hitler was an orphan raised by an adoptive Jewish family, he might have turned out to be a completely different person in history. It's not as if there's an archetype of Hitler as an anti-semite existing somewhere outside of existence.

Most of us who fantasize about winning a million dollars, or going back in time to relive life, do so with the assumption that you would end up being the exact same person we are. But in reality, even a small event can completely change the course of history, so how can the individual hope to also remain the same.