OP
You are living in a darkness born of myth, and I wish I could point you to all the threads on A'gon that go something like "omg, I raised the crossover point on my speakers and they sound so much better!"
The higher crossover point minimizes distortion by leaps and bounds and it is completely a positive thing.