I took my baby to many swimming holes. The hardest thjng is schlepping all your gear into what are sometimes hard to access spaces. Most swimming holes are pretty family friendly though you’ll occasionally encounter people being assholes and partying and letting their dogs run all over your stuff. The other thing to remember is that a lot of infants don’t really regulate their temperature/cry out in the cold-river temps are quite chilly until at least august so you just need to be mindful of not letting your kiddo spend too long in the water.