>I told him my worries (many different reasons) he is kind and understands my point of view.
>
>...
Should I talk directly to him and say: I will never want kids, I won‘t change my mind, can you accept that?

Wait, if you haven't told him that already, what have you told him? What exactly did you say when you "told him [your] worries?"