Streaming can bring you, via the internet, virtually all the music in the world (as long as it's been digitized and made public). This in my opinion is its biggest advantage. Opinions vary about its sound quality compared to analog (vinyl, RTR).
If you own a smart phone and headphones, then you already have a streaming platform of sorts. Subscribe to a streaming service (Tidal/Qobuz/AppleMusic/other) then download the supporting app to your phone. This is the way millions of teenagers and young adults listen to streaming music. I prefer to listen through my main stereo rig, but a smartphone and cans provide a good way to dip your toes in the stream.
If you decide you'd rather listen though your main HiFi system, then in my opinion, a Blue Sound Node (~$600 US) is a relatively simple and low-cost way to get started (via a USB/Coax/Toslink or analog RCA connection to the HiFi rig, plus application software you run on a smartphone/laptop/desktop/tablet).