You definitely would feel the backward acceleration of both the gun and you moving backward. This is exactly because you and the gun aren't one single rigid entity. If you have watched any slow-mo gun firing footage you will see the gun moves first after a bullet is fired, then the shooter's arm starts moving a short while after. The same thing would happen in space.