Speak to a lawyer about this rather than making assumptions (if you haven’t already). Agreements are only enforceable if a judge agrees. Family courts are (supposed to be) about the safety and best interests of the child.