My Demo results: I feel like I'm at a frustrating block in my speaker journey

It's nice of everyone to give their good advice, but I think that it's probably pointless in this case since you are very particular and will need to hear what you like for yourself, and it looks like it's going to take you a while... 

With the room layout and speaker placement limitations, I'd focus on bookshelves placed on your cabinet (on some sort of 2-8 inch stand like Iso Acoustics) and add a small subwoofer.

Bookshelves would have at least a tiny bit of room off the back and side wall, and there would be a little space available to work on placement.  

Considering the sound profile you're looking for, perhaps you should consider the KEF LS50 Wireless - which have a good reputation for detail and clarity.  

The KEF LS50w's are active speakers, so you would no longer need the Marantz AVR. Your TV would connect to the KEF's via optical.

A small sub might fit in that space under the marantz.

The non-active LS50's I guess would be an option, too - but I'm not sure how well they would mate with your Marantz. Might be something to try first, though.

I think the Paradigm Persona range is exactly what you want. Just make sure it is demo’d with gear on the warmer side. Devine with Luxman gear

I went through this for awhile. I think most of us do. Depending on price point and whether you have size/aesthetic constraints, there are a few things you could do. 1) Buy what most approximates what you want and wait until the more desirable speaker eventually comes your way. 2) Find two sets of speakers you like that do different things well and run them together...I did this for years using paradigm and polk. Paradigm added body to low to mids, Polk upper mids to highs. 3) Try headphones.

My final speaker at a price point was Focal 807W (at a price point). They do almost everything better than most speakers I have heard (for me) and I prefer the older tweeter over the newer Poron, but they are metal tweeters. The AA with Raal seem to be as you describe, lacking a midrange punch or excitement, comparatively speaking. My suggestions for newer equipment would be Triangle Borea 3 at $600ish,a speaker which has received alot of attention, Monitor Audio Silver 100s at $1200ish which has become more dynamic than previous models were..so maybe more forward rather than laid back. Above that, the Sky’s the limit. The sweet spot has to reside somewhere between 1-2 grand but there are some performers for less.

What I look for is clarity with dynamic reach or "exciting clinical". Not too airy, too large a soundstage (stretched) or too small. Something that adds depth of sound rather than flat wall so more 3D vs 2D.
Let your brain adjust. The brain is like an infant, you’ll eventually desire the taste for what’s on your plate. Don’t forget, amps and sources can make a difference too regardless of what some people say.

Your problem is probably related to eletronics. Thinking about sound systems you should always consider the pairing eletronics with speakers.
i will tell my story so I can express myself better.
i bought a few years ago a set of B&W diamond series. Supposed to be top of line. Paired with I could afford at that time. A Yamaha 2030. It was good. But is was not good enough for what I have payed for. Experts were saying to me that the problem was power. That I should buy an amplifier do push the speakers. I went then to listen to many amplifiers with the same speakers and same processor. I’ve got the NAD M25. It was a great upgade to my system. But then again... I was not satisfied. It was pricy but far pricy for what I have payed for. Then I changed my processor. Now I am satisfied. So, thinking about sound you should consider the whole system and not only the speakers. Start upgrading your processor, then your amplifier so you can match great speakers