Look into equal loudness compensation.

Humans are less sensitive to bass and treble at lower frequencies, so there is a tendency to turn the volume up to "hear everything." Maybe you can give the bass and highs a boost so everything sounds more even and your average listening level is still quieter.