I'd have dropped my brother out of my life after the first time. He has no respect for you, or your partner. Get away from him, and if your girlfriend decides to choose him... well, her decision, her fuck up.