Take the trip without him. Spend three days looking after yourself and examining the relationship as a whole. At the end of it all ask yourself if you are looking forward to seeing him again and going back to how things are between you. Anything other than a definite yes means its time to call it quits.

Relationships can't be 'sunshine and roses around the door' all the time but the overall general vibe should be happy and fulfilled, not frustrated and drained, which sounds liike where you are. It's very possible that you've simply outgrown him and a break might be just the clarity you need to accept that.