It is in fact a horcrux in HP terms. Sauron died, all that was left behind was the One Ring, which was forged with a piece of Sauron's essence. Because his spirit was anchored to the One Ring, Sauron was able to slowly reconstitute himself over centuries until re-emerging in Mirkwood, then being driven out of Mirkwood and returning to Mordor.