If your goal is to save on taxes, then yes, you should get married.

Withholding is only an estimate that gets reconciled when you do your tax return at the end of the year. So in one sense, yes it will lower your taxes for the months before you get married on paper. But in a more literal sense, you will not get 'corrected' paychecks or money returned early or anything like that.