Which is the misconception.

There would be few collisions. Galaxies colliding is not two cars smashing together, for lack of a better image it is on astronomical scales more like two gases mixing.

On a time scale of millions to hundreds of millions of years. Same for stray stars getting ejected.