I have this exact problem and tried many times to locate the source. After a few years I found out (hearing test) that I have a significant hearing loss in my right ear. It’s a fairly narrow bandwidth, but I barely hear anything in that band. It’s the root of my tinnitus. Music that’s engineered with instruments panned wide left/right is fine, but anything subtle has a distinct left of center image.