Stop mentioning it / bringing it up unless he does. He said he doesn't want to talk about it, but you keep shoving it in his face.

Yes, he has a right to be pissed. Most likely he'll eventually get over it, but you continuously bringing up just because you feel guilty is making it worse. Stop.
If he valued your relationship he will get over it pretty quickly, but that's not going to happen if you -keep bring it up-.