You shouldn't have agreed to get back with him when you hadn't forgiven him for what he did and there were no signs that anything had fundamentally improved. I think that it would be better for you if you get more realistic about how you actually feel than continuing on in this relationship (which as it currently stands, also sounds deeply unpleasant to be in and virtually a non-relationship).

Don't stoop to his level. With each passing day you are just wasting more of your time, heart and youth in your relationship, you need to break up.