You weren't rude op, you just misunderstood that old man. He was the rude one here. Also, him shoving/touching you without your permission was absolutely not okay!