In certain situations, the "phase" of a sub can be out of alignment. If this is the case, the quality of sound will appear like it's having some issues - and not in synch. If this is the case, you can adjust the phase or polarity switch to improve the sound.
You should not have to use the switch in one position for music and in another for movies. Once it has been set, it should be fine for both types of listening.