I was in a situation like this way back when. My old gf was ready to hop into bed before I was ready and we had to take it a bit slow (which frustrated her quite badly).

I would say that this guy is either hesitant to push into the physical aspects (which has nothing to do with you) or doesn't want to come off as overly sexual. I would say that engaging in smaller acts of touching can help make him more comfortable with being closer to you and will lead to more intimate acts.

It'll come with time. It isn't you doing anything wrong, he just probably doesn't want to fuck this up (ironically).