Wait long enough and every system will tend toward its highest entropy and typically lowest energy state. But then we’re not really talking about the effect of the magnet’s magnetic field anymore so that’s a whole different conversation that depends on things like the stability of atoms and protons.