I will tell my (2 channel guy) story:
Dont watch much TV. Just had a tele on the wall and couple crappy B&W wall mount speakers. Then I added a Velodyne Micro Vee sub. wow much improvement.
New GF likes streaming movies and with all the new HD concerts on the YouTubes i figured I would build up a modest AV platform. Gots new Tele, got a Denon AV receiver on close out, those are alway available for considerable discount. Added a couple of nice used bookshelf speakers and then got another deal on a used nice center channel from LD. Then got lucky and a friend gave me a nice DAC. Kept the Velodyne sub. All in proly got ~$3k totally invested in I suppose what would be called a 3.1 system. Don’t really need the surround stuff for my requirements. Just added a cheap blue ray player the other day to primarily watch music performances.
It took some time and frustration to get the AV dialed in to make the system balanced and sounding good. Lots a knobs to turn and new things to learn about the set up.
To anwser you question: I think its totally worth doing as you can go as small or as big as you want and make the system sound a bunch better than a fancy sound bar. And totally worth doing if you like watching concerts. I just checked out a blue ray from the library of Sonny Rollins 1965 performance in Denmark with Niels-Henning Ørsted Pedersen on standup bass. Alan Dawson in drums, Dawson taught some of the most famous jazz drummers in the world. After watching this I am soooo glad I invested.
https://www.jazzicons.com/ji3_rollins.html
