If you're employed, can't afford housing and move out, you're no longer counted in the labor force of the state you left.

Do people get priced out of New Jersey? Yes. Is it a torrential flood that's leading to a hemorrhaging population? The 2020 census showed that was not the case, and I've seen little evidence indicating the estimates of the last few years are any more reliable.