I think most shower doors thresholds like that are in fact just meant to be stuck down with silicone caulk. So yeah, just get all the old caulk off both sides and stick it back on there.

Probably pay special attention to looking for potential leaks at the ends, and make sure to get the silicone in there such that it seals it up the sides a bit too.