I would avoid using any type sandpaper- the glued particles (sand) come loose from the paper and will promptly lodge themselves in the grooves of your new lp. I would get a sharpening stone, which comes in various grits, to remove the offensive material, if it bothers you.
