Dryer lint isn't good for them. They're soaked with whatever chemicals you wash your clothes with like detergent and softener. There's also a risk of baby birds getting entangled with the fibers, or the adults birds getting their feet caught.

Also unlike fur if your clothes have synthetic fabrics like nylon, it wouldn't break down over time, so you're really just introducing fine strands of plastic into nature.