Do what makes you happiest! A good rule of thumb is checking the footnotes when you find yourself feeling curious.

You’re never going to understand every reference or cultural meaning. I’d argue even scholars can’t do that. So your happiness and what fulfills you is most important. Learning is good, but so is becoming immersed in the story