Fuzzy distortion on vinyl........Stylus issue?

Need some advice from the Turntable & Stylus crowd. I have an issue whereupon my vinyl has a tiny bit of fuzzy distortion when playing. This happens on brand new 180g albums as well as my collection from the 70's-80's.
Is this a stylus issue? or my cartridge (Ortofon Red MM)? Streaming & CD/SACD sound fine.