If you want physical books, and you're able to plan a trip to a library, see if/when your nearest one has a used book sale. They're usually a few times a year. You can donate everything you're done with, and get some new books for very cheap.

If you decide to go to kindle route, Unclaimed Baggage is a great place to find them used.