He may just be hung up on that term. Ask him what's the difference between "my girl" and "girlfriend".

Sidenote, I'm not a fan of my girl, sounds possessive and even stronger than girlfriend tbh.