It would be absurd IMO to change the speakers, preamp, amp now.
When you tame the volume, your Preamp’s volume control can be used/set to it’s ’normally best’ most linear position rather than it’s minimum starting point. That is a benefit!
These units can be used ’up front’ to select up to 4 sources and control each volume into your preamp,
OR, between the Preamp and Amp
ALPS Remote Volume Control
https://www.aliexpress.us/item/3256804138895759.html?src=google&aff_fcid=935f07f9b1c748348354370ac9bc6f3b-1703254601863-06284-UneMJZVf&aff_fsk=UneMJZVf&aff_platform=aaf&sk=UneMJZVf&aff_trace_key=935f07f9b1c748348354370ac9bc6f3b-1703254601863-06284-UneMJZVf&terminal_id=9e131df15aa34acea8ffefb4ac5e99e0&afSmartRedirect=y&gatewayAdapt=glo2usa
My beloved Chase Remote Line Controller can be used similarly. None of my Audiophile Friends can EVER (over many years of blind tests) hear any difference whether it is in or out of signal path. It just does it’s thing to your advantage!
NOTE: MUST have the remote for the Chase unit, no controls on the unit.
The Chase has the added benefit of Automatically/Progressively implementing Fletcher Munson ’loudness’ (low volume bass boost), which would definitely be an advantage for you.
Default volume and higher: FM not in line
lower than default, FM begins, slight and more bit by bit as you lower the volume.
.................................................
Try the Chase, keep it, or I will buy it from you, never hurts to have a spare for me or a friend.
If you use it for a while, then solve it by other means, then if you want, I'll buy it then.
btw, I am using one Chase unit in my Office System simply for remote power of the system, then the Luxman Integrated (it's power switch left depressed) for everything else, including it's input selection; phono MM or MC; remote volume and mute.