Wait.. Is this something you bought designed to be wall mounted? if so, follow manufacturer's recommendations.
In a speaker enclosure, damping material lessens reflections, but also increases internal volume, so it depends. I have seen some delightful, tiny speakers use internal wadding, to good effect.
Best,
E