Yes, if you have a pretty quiet room, you should be able to hear the difference. The difference is reduced quite a bit if you are using one of the newer, lossless codecs like LDAC or AptX HD.
That said, if the source material is compressed (say mp3 or whatever Apple uses), you may not hear a difference from better transmission. But if you are using uncompressed digital info, say from FLAC files or Tidal or Qobuz, there will be an improvement from avoiding Bluetooth.