A
Anonymous
Guest
Beethoven Was Deaf should be top of your list.
You should get the HMV/Parlophone Singles 3 CD set, which makes World of Morrissey and My Early Burglary years pretty much obsolete (except some minor mix and edit differences).
The HMV/Parlophone Singles set also sounds much better than the original singles do. There's no remaster credited (IIRC), but something must have been done.