@OP. I have no experience of the Totems but it is certainly the case that certain speakers do not sound right at low volume levels and sensitivity measurements are not always a perfect guide to that. You could try something like a pair of DeVore O series - that will tell you if there is potential for a speaker replacement.
I'm curious, given the room dimensions and the picture with the LPs, it looks like the speakers are about four feet apart. Are you really that compromised regarding placement?