I've used FiiO MP3 players in the past, and the lower priced oned work great, even after many years. Small as an Ipod, and great battery life.

I only stopped using them, when we switched to Spotify/streaming.

Maybe consider a smart watch? You could gather useful data about your run and play music too.