Human touch is a basic human need and if you're in monogamous relationship, he is the only person who can provide that .

If he is not capable of understanding that, or willing to come up with a reasonable plan, then you only have one choice: dumping his ass off.