I don't know if you've seen measured specs and/or reviews from Stereophile, but here is one account, https://www.stereophile.com/content/audio-note-e-lexus-signature-loudspeaker-audio-note-espe-he-august-2008 May, 2006 issue has specs on Lexus version, Atkinson measured 92.5db sensitivity, also stated, "I don't think the speaker will make significant demands for current on the partnering amplifier, which, in combination with the high sensitivity, makes it very suitable for use with flea-based single-ended amplifiers". Based on those specs and Atkinson's conclusions the 300B should work with the AN-E. I'd try out some subs before concluding your not a SET guy. I'd also suggest REL's, they are unique in their designed to connect to high level connections on amp binding posts. I use two with my modded Khorns and they made all the difference, not just lower fundamentals in bass, but sound stage, imaging, better tonal balance as well.
Now I did run Merlin VSM speakers some years ago, somewhat similar specs to the AN's, used those with both push pull and 845 SET amp, always preferred them with 845, bass much better than any EL34 and mids better than any KT series. Just for kicks tried them with some 2a3 monoblocks I had, no way, sounded like one of those pocket transistor radios. Of course 300B somewhere in the middle. I just wouldn't be so quick to get rid of what you have, your Aric audio amp and pre are fine pieces, almost pulled the trigger myself on his two enclosure 300B amps.