back in the late '90s i'd always find a lot of really cheap moz/smiths 12" singles at generation. their vinyl section went down hill at a point though, becoming less prolific and also more pricey, kind of like everything else in new york.
Smith's Bar, just outside of Times Square on 8th and 14th, opens early to show EPL games. Bleecker Street Records and Generation Records are good, in the village. Also down there is Record Runner. He has 80's vinyl and likes Moz.