I just visited Hadrian’s Wall at Birdoswald and the museum claims that the decline of supplies and pay forced the Roman soldiers (from all parts of the empire) to start local farms/businesses. They never left.