He made his own fair game by trashtalking yours. It's the same logic as "Don't ask if you have problems with the answer". Or challenge you with "you won't dare anyways" and then complain when you do that thing.

You have no reason to overly blame yourself. You weren't even specific, you remained well within the bounds of what friendship allows.