If everything you're saying is true, then it's not going to matter if you go out with them. They'll give you the same amount of shit next time. Sounds like they're just looking for a reason to dump on you. I'd say cut your losses now and find better friends that actually like you.