I have found that headphones sound different, not always better. Since you do not have to deal with room acoustics, it is easier to design a good set of full range headphones. These are easier to drive and do not have the amplification requirements of speakers as well. Most people do not give speakers enough power. Meshing the speakers with a sub is another difficult task.
For what it's worth, I love my headphone setup. There are so many things it excels at. I still find myself listening to speakers more than headphones. The stereo separation in headphones can be unnatural on many recordings, and you don't get the full experience where you feel the music as well. It makes a bit of difference. Hard to describe.
Of course to get a speaker setup on par with a good headphone setup, costs about 5-10X as much.