I have no idea about headphones, but I recall a buddy of mine messing with the magnets in his guitar pickups and it caused some serious issues for him. Signal cutouts galore, and the biggest kicker was that, somehow, some magnets were demagnetized by the other magnets.