Never stay in that situation. If you do, your boss will start looking for a replacement for you and let you go in a couple months once they have somebody, and then your new job offer is long gone.

Even if your employer lets you stay, there is a high risk you won't be considered for promotions/raises because you are a "flight risk" and have "one foot out the door already".