This is one of those things I've sometimes seen depicted in media, but I'm convinced isn't something people actually do. But if you're determined, maybe try a bathtub tray and don't submerge your upper body so water doesn't drip onto the book.

Edit: Apparently it is something people do! Ignore me and take their advice! I need to jump on this cozy bathtub reading wagon!