Tonearm buzzing question

When I touch the tonearm (or even the dust cover) of my turntable, I hear a buzzing sound from my speakers. Is this a grounding issue? My turntable and integrated amp I believe both have places to hook up a ground wire (for analog). Will this solve this "problem". Is it okay if I leave it as is...once I let go there is no buzzing.