This is his own issue to work through and trying to control your behavior as a way to manage his anxiety isn't appropriate. It would be one thing to ask for an occasional check-in/update to reassure him that you're safe etc, but getting upset at you for doing completely normal and healthy activities is unreasonable. Sounds like he needs some therapy.