When I upgraded from the Xbox one to the series x, I transfered all my game data to an external drive and them moved what I was playing the most onto the Series x, and didn't notice any change in game data/progress, so I think what you are asking is possible.
Wrong_Mulberry_4067 t1_j4px2b3 wrote
Reply to Swapping hard drive data from Xbox one to Series X? by SkidWheelPlayz
When I upgraded from the Xbox one to the series x, I transfered all my game data to an external drive and them moved what I was playing the most onto the Series x, and didn't notice any change in game data/progress, so I think what you are asking is possible.