I've done this for years with a full-fledged home theater DD receiver. However, I never run at anywhere near max volume so I suspect I'm within the limits of the specs of the receiver, even though the speaker's output impedance has significantly decreased.
On a small mini-system I'd worry about...