How good is he, if he doesn't care about making you feel loved? That would erase any sense of 'guilt' I had about leaving.

And in any case, staying or leaving a relationship isn't any moral judgement of character. It's simply something that does or doesn't happen based on compatibility, as you said. You are the one somehow conflating it with a moral judgement and making yourself feel guilty because of it.