Yeah, I hear ya. I'm always worried that my neighbors are going to complain so I pretty much just leave it off. I actually enjoy the music more, probably just because I know there won't be a knock on my door.
I rarely use my sub nowadays since I live in a apartment highrise. Sometimes, during the day I'll give it a slight workout but I never get much carried away, I don't need anymore noise complaints like I had last year. I actually like listening to music in multichannel more than I do cranking...