40 watts is plenty. However, not all 40 watt sources are created equal. If you have a 40 watt amp with a huge power supply and all the current capability, you'll be fine. but if your 40 watt amp is a typical amp with just bearly what it takes to get a 40 wpc rating, it probably won't handle the heavy load the your speakers are.
But if you buy a 600 wpc amp, you can be pretty sure that at lower power it has all the power and current necessary to excel at the lower power.
Make sure your 40 wpc amp is getting adequate power. it should be plugged directly into the wall or something with high current like a PSAudio power plant. 10 awg power cord. avoid the passive power conditioners.
Jerry