Depends how "juicy" your preamp is.
An amplifier can be colorful, but it also has an interaction with the speaker load, so hard to drive speakers may sound very different depending on amplifier.
Swapping out very neutral performing preamps may do little for you, but going from a neutral to juicy/colorful preamp will seem like a big step.