Communicate with him. Tell him your actual income and left over amount you have for disposable income after all your expenses are paid. Stop turning down his offers. He wants to spend time with you and share experiences for you, you declining is silly, he has the money and he wants to spend it on/with you. You're being overly proud and hurting yourself, your relationship and your partner as a result.