If you can find a new complete unit that fits in the same size hole as the box of your existing unit, I would suggest doing that. You can get something quieter with better features.

But, if you're like me and there's no new unit that fits in the same size hole, yes, you can replace just the fan part as others have described. I was able to get a replacement for my very old fan from Supply House.