Just replace the fill valve. It’s super easy and some don’t even require tools. Takes like 10 minutes.

I’ve had this happen to a couple toilets and it sounds to me like your fill valve is failing.

Reach in there and lift the float manually. If the water does not shut off then the fill valve is bad. If it does shut off when you lift it then it's just a matter of adjusting it.