I would certainly attempt to get to the leak. Especially if it's on a upper floor. In two years it could weaken the structure enough that your next bath will end up falling through to the floor below. Covering up and treating the mold you can see won't stop it for good it grows fas and you can get sick by the stuff you can't see/reach.