Use a paint scraper/putty knife to get off the glue - sanding that will probably gum up the sandpaper and be very annoying (not to mention making some nasty dust). Then cover the holes with spackling. At that point you can sand, or just paint if you're not super picky.