The effect comes from the pressure exerted: the force divided by the area it acts over. The tip of a bullet has a very low area thus a very high pressure because all the force acts through a single point. The recoil is an equivalent force but the gun is held in one or both hands so the force pushes up the arms to the body and acts against your whole body mass, thus dissipating its effect.