Sounds manipulative.

End of the day, you have to do what's right for you. You can attempt to remain friends, but a clean break is needed for you. You can't keep living your life in the shadow of this. You can not allow him to play on your sympathies while you continue to not live your own life.