I guess you'll gonna make it worse if you keep it longer. It's also unfair to your partner that you have thoughts about "breaking up" and he thinks the other way around. He deserve to know the truth about your feelings.