One downside to allowing priests to marry would be the financial burden. It would double (at least) their overhead and require parishes to put up the money for their wife and kids. It’s not a simple switch you can flip, and many (maybe most) parishes would not be able to afford married priests.