I had an analogous situation. I have Dynaudio Gemini speakers, which aren't quite as nice as the 3.3's. I haven't heard the 3.3's, but here is my experience with the Gemini's:
I first used my speakers with a Harman Kardon PA-5800 amp (80 watts/channel) and a Lexicon CP-3 (I was experimenting with the idea of a music surround set-up), and also with an old NAD 7100 receiver (60 watts/channel). I also tried the Dynaudios with my main home theater set-up, which consists of a Lexicon DC-2 and a Marantz 5 channel amp (170 watts/channel)(I A-B'd the Dynaudios in 2 channel mode with a pair of M&K S-100Bs). I was disappointed with the sound of the Dynaudios with these setups. The bass was muddy and the midrange wasn't "there" (but the tweeters produced excellent highs).
I then got a Musical Fidelity A-300 integrated amp (150/channel). The Dynaudios really came alive. The bass is much tighter and the midrange is lush. The tweeter is the best that I have heard in my limited experience. The sound is musical, yet detailed in a way that is not clinical sounding. (I sound like a hoity-toity reviewer): )
I'm very pleased with the Dynaudios and have given up the upgrade bug. (for now): )
Given the above, I suspect that an upgrade in any of your equipment will produce an improvement in sound. The problem is not with your speakers, IMO. And, the problem is not necessarily with the amount of watts generated by your amp. My 150 watts/channel MF sounds better than my 170/channel Marantz (albeit with different pre-amps). It's the quality of the watts, not the amount, IMO. I haven't heard the Adcom GFA-5800, so I can't say if another amp will make a big difference for you.
In your price range, you should consider a Musical Fidelity amp/pre-amp/integrated amp. JMHO. This is just based on my own experience.
Perhaps the MF sounds good to me with my Dynaudios because it is does not have as much of a "digital character" as my other equipment. As I think it through, you might want to look at tube equipment or tube-sounding equipment like the MF. I'm sure that there are several excellent choices in your price range. Maybe you can use your $3500 budget and get a BAT amp, or another fine tube amp, and live with the Marantz for a while. Good luck!