I built custom speaker systems for a living for 14 years (and moonlighted as a musician and live sound tech), including pro sound reinforcement, studio monitors and hi-fi speaker systems. The company that I worked for had access to raw speakers lines the likes of JBL Pro Series, Altec Lansing, Electro-voice, KEF, and several other brands. Of course I built my own systems several times over the years as well since I could access the components for dealer cost + 5%.
My advice to you is save up for the factory builts. You will thank me later :)