These are my favorites the non-hardcore fans overlook:
Yes - Going For the One (Especially Awaken).
Pink Floyd - Animals (Just dig it for some reason)
Rush - Permanent Waves (Better than anything else IMHO)
Kansas - Masque
King Crimson - Discipline
Also,
King's X - Gretchen Goes to...