Don't blame a show for your inability to put your phone down.

Yeah, this was a pretty weird plot hole. There is no way he would know and he didn't follow them because they were on foot. I don't think he should know about his daughter's game at all, much less where it is or what time. It's possible something was left on the cutting room floor in relation to it.