A CPU is a dremel: can be used for a lot of different tasks and pretty good at most of them.

A GPU is a chainsaw: far more narrow in what its useful for but far more efficient for that what it is good at.

And while you could cut down a tree with a dremel, there are good reasons to use a chainsaw, especially if you need to cut down a certain number of trees per hour.