Yes, I do it all the time. My glass has latches and a hinge on one side so it can be swung open for cleaning. I don't bother turning off the pilot light or anything, but if you're overly paranoid just close the gas valve.