So, I read Ron Kirn's warning on screwing the pooch if you use a drill bit to remove the built up finish inside the tuner holes. Just to prove it to myself, I did it on a test piece of wood, and you can see the results:
That scared me, so I bought a dremel kit and a small file kit. I even tried an experiment with a piece of sand paper wrapped around a drill bit (the sand paper ripped after a few revolutions of the bit, and the metal started digging in and the wood spun).
In the end, I went with a small round file, and it was a 15 minute job with a small fine file that was rounded on one side:
The bushings fit in snugly, but I didn't have to hammer them in: