Yes remove the old caulk. Make sure the area is clean, smooth, and dry before applying. Do not recommend silicone. It is hellish to remove and does not stick to itself when dry so basically ruins all hope of redoing in the future without extreme steps- and definitely doesn’t last forever. Use a quality sealant instead- Lepage Quad or Flextra for example.