In a lot of respects I agree. I rarely refer to my notes (except for work purposes). It's more like I'm writing the notes as as some sort of kinesthetic way of memorizing or plugging it in my head or a therapy. I also rarely refer to my writers journal for the same reason.

Personally I'm loathe to toss out my personal notes. Thay said, it may be many years down the line that refer to them... but I may wonder "who the hell was that idiot who wrote these notes?" :)