A few things yes you are/were in love with him.

When there is a big difference in age - people tend to be judgemental. Seems you are involved in a church that inter fears in people lifes.

Discuss this with your parents. As they like him maybe they can ask him if he loved you or not. If he stopped coming because he did not love you - at least he is an honest man. If he loved you - he is not talking his life seriously.