How often, and how, do you clean your stylus?

I used to brush the stylus before each side played but now I think that is excessive, so I check it with a jewelers loupe.  I also rotate between the brush and sometimes use Blue Tack instead of the brush.