You need therapy. Hes not taking anything away hes setting up a boundary and youre playing victim. He may have trauma ffs. And here you are being self interested and abusive by crossing that boundary over and over. Hope he ditches you and you never find a daddy.