I’m in the camp that everything matter within reason. If you have a Service Merchandise speaker with a VAC amp and a Nordost loom I think you not get the most out of the amp because the speakers are K-Mart.
If your room is less than perfect you will likely hear the difference a good pre can make but to me you're wasting money in fear of being beaten by the WAF stick.
You ultimately have to realize that you are playing at your own level and it needs to be fun.