From what I have experienced, your headphones/earbuds might have a siginificant peak somewhere in their frequency response. Play a sine sweep and if one frequency becomes too loud try to remove it in EQ. My particular headphones have a vicious peak at around 9000Hz that makes them unusable for long periods without EQ, so I'd try that first