If you don't have a lathe, I would leave the blank oversized when you drill the hole. Then put in the hardware and sand it down while the ferrule is connected. I would get a center finder to mark the blank before you drill. A drill press will help keep your hole straight.