Maybe I am not a real Rhode Islander, but to me:

Water bubbler = the water dispenser with the 5 gallon jugs you invert on top then dispense into a cup from the spout below, which bubbles as you remove water from the tank and it gets replaced with air.

Water fountain = the device you drink straight out of, which is connected to the water main and shoots the water up in an arc, like a fountain.