Its considered unethical for a doctor to have romantic relations with a concurrent patient. In general people expect their doctor to keep things professional. So it's a bad look for him and the hospital.

I actually have less issue with the consensual act in the bathroom than I do with the doctor having an inappropriate conversation with a patient as it would make someone who wasn't interested very uncomfortable.