Some favorites, off the top of my head:
Big Black - "In My House" (Mary Jane Girls)
Black Box Recorder - "Rock'n'Roll Suicide" (David Bowie)*
Th' Faith Healers - "Mother Sky" (Can)*
Galaxie 500 - "Ceremony" (New Order)*
Husker Du - "Eight Miles High" (Byrds)*
Jawbox - "Thin White Line"...