How long will it take you to pay back the 401k? If you could pay it back quickly, I don’t see it has harmful as others might. I took 10K from 401k but it was paid back in like a year and my retirement is still well ahead of the typical markers.

But if it can’t be paid back quickly, I would not touch my retirement. If your house appreciates or once you get to 20% you can get it taken off most mortgages.