I agree with you. The Howards of Virginia is not a waste of Cary Grant's talent.
Unfortunately, the same cannot be said of a Cary Grant movie I didn't know existed until I saw it on TCM the other night, Once Upon a Time (1944). To be avoided at all costs - YUCK!