No need for a matching box. If you watch your volume, direct wire from the taps is best.

Cheap speaker amps might have a higher noise floor, but the higher end stuff is almost invariably better than high-end headphone amps, being over-engineered to drive harder loads.