Unfortunately, yes. Our area has especially hard water, so it’s kind of a pain in the ass, but it’s worth it not to waste so many plastic jugs / keep my houseplants (& sinuses) happy all winter.
ETA: this one is the one I have they have nicer ones, but this little one has served me for three years now.