The remote-juggling problem is solved by a good remote control with macros for switching source/inputs, like the MX-500.
For me, I route some video through my receiver because I don't have enough component inputs on my TV for my XBox, DVD player, and HDTV STB.
Also an important consideration...