The Eastern Empire/Byzantium was more or less surrounded by the turks. In its latter days, the empire was a diminishing island in an Ottoman sea. The western empire some places, like Britannia, it more or less disappeared overnight, others, it just withered away. I suppose there was a lot of internal displacements in such turbulent times, but mass migration from west to east, seems unlikely. To me, that is :)