Then do as your therapist suggested and take a break but don't go back to him if he starts to make pretty promises. Let him know that he has to put the work into the marriage and himself if he wants to even have the chance of getting you back. If he doesn't then your marriage is effectively over.