Or like, I dunno, ask kindly?

If it's his property it's his property, fair play, but don't attack the dude over it. If you want him to leave, ask nicely and if the guy makes a scene about it then get the authorities involved.

That's the thing, about 90% of these videos I've seen the person going full Karen doesn't have any legal reason to be involved. This is the first time I've seen one of these where it's the actual land owner (not that it makes him less shitty) and not some rando walking on the street.