To a certain extent, yes. You should take an antipyretic if your fever is high (above 39.8°C) and doesn't break. At least these are the recommendations I've always gone by myself. It just prolongs how long the body will fight off the virus. This is the same for cold and flu medicines.

Medical knowledge here: to add on to what others have said, if your body stays at a high enough temperature for a prolonged period of time, there begins to be damage from it. Hearing loss, brain damage, seizures, vision loss, etc.... It has to fluctuate to keep the body alive aka homeostasis.