You're not married, and have no kids together. You can leave for any reason, or no reason at all. Any break-up will hurt someone. Just accept that there's no good way to break up with someone, rip the bandaid off, and move on.