It’s because you don’t have it setup right for starters your modem- router combo should have a good Linear power supply and quality power cord linear tube audio $750 fantastic LPS and you can hear the difference
the sw8 Ethernet hub I bought for $600 has a over controlled clock,telema linear power supply and other things 2 high quality Ethernet cables mine are $1k each
all these things add up