It can also be the room, or speaker/room interactions by the way. You can experiment with blankets and pillows. Put some around the room and see if they change that aspect of your listening. If they do, in a positive way, consider room treatment.
The walls are an obvious choice, but I've found that some of this hash lives on the floor between and behind the speakers.