The downside, is the wear on your amps occur, even when, you are not listening, and the cost of electricity. The wear, is minimal, with solid state gear, but with tube power amps, it will reduce the time, of tube replacement, to approx. 1/4. If the tubes lasted 2 years, listening 6 hours a day, then they will last only 6 months, listening 24 hours a day.
The electricity costs, will vary, with type, of amp. Class A, will definitely add considerablely, to the costs.
The cycling on, and off, is definitely hard, on gear, both solid state, and tube. Manufacturers, had added a lot of features, to minimize this, such as "softstart", to gently apply the inrush currents.
I use tubes, on the midrange, and high frequency, and solid state, on the bottom. I shut the tubes down, whenever I am not listening. I leave the solid state on, continuously. Lightning strikes, is the only reason, I shut it down, and unplug it. I even use, a little trick, of coiling the last 2 feet, so if a huge surge hits it, while I'm not home, it will melt the cord away, at the coil, and hopefully prevent the juice, from getting to the amp.