There are two "noise floors." There is surface noise floor, the clicks and pops on a lp, and there is the noise floor that one can hear through to the "quietest of sounds", as Viridan points out.
Referring to the latter, digital (redbook cds) has a higher noise floor because digital does not deal with information beyond 20khz or below 20hz. Analog has a lower "noise floor" because it is able to reproduce a greater range of information- regardless of whether we can hear (through the surace noise) or sense it. And therefore, analog has the potential to sound more complete.
In the best possible analog setup with top quality lps, the surface noise should be a minor concern. Issues of cost, convenience and availability of music should be addressed before spending a lot of money. In all likelihood, a $2000 cd player will sound better than a similarly priced turntable setup (tt,cart, and phono amp) and, of course, will have less surface noise.