Or it is over filled. This will cause rolling resistance even in a plain bearing design.
Bearing 101 do not over lubricate, more is not better.
The only viable reason I can think of that might cause that would be the spindle oil needs to heat up a little to thin out so the table can reach full speed. In which case I would use thinner spindle oil