Consultants are fine for solving a problem or managing a project that you rarely need them for.

But if you regularly use them, then, as you said, you're wasting money that could have been spent to build out a full in-house team.