I think it is worth communicating your feelings to him and letting him know you’re disappointed that you can’t go too. You probably should also tell him that you feel conflicted about him going on a romantic trip without you after he spent so much time discussing travel with you. He sounds a little clueless imo