We had the exact same issue the last time we bought 22 years ago. A big factor in the house we bought was that it did not have this "forced" TV location.
A few years ago we decided we were ready to go and looked for a new house for a full year and never found anything we both liked, so I talked my wife into buying a nice, big, 5-acre lot and I got to work designing the house to go on it. Great room has the fireplace right in the middle of one of the long walls, flanked by double french doors on both sides that lead to a screened porch. I also don't like the TV being in a prominent location, i.e., it's the first thing you see when you enter a room, so I left one of the short walls (but only 4' shorter than the long ones) as a "blank canvas", meaning no doors or other interruptions and you have to be pretty much in the room to even see the TV. Pretty unique for an open concept (which we do still like after living in one all these years). I also have a dedicated media room (16'6" x 22'), designed just to my liking.
Covid, of course, made building nigh impossible for a while but we're within a couple weeks of getting started now, just in time to pay sky-high interest (comparatively)! We're just gonna have to suck it up and get this place built.
Another advantage of building is that you have control over how your house is built. The builder doesn't dictate to me, it's the other way around. I'm the customer. I'm doing lots of non-standard things including 2x6 exterior walls (virtually unheard of in the south) and geothermal HVAC. Yes, building can be quite an undertaking but it's the best way of getting what you want.