Volume imbalance

When I adjust my dual volume control I can almost never seem to get each channel to equal out.  I can adjust one side but then it's just a little bit louder than the other. I believe it's the nature of the tolerances of the stepped Alps pots. I've got room for the Khozmo controls. But I'm not sure if this the way to go. I'm looking for opinions/experiences or suggestions. Thanks for any help. Would an audio taper pot be ok?