Here's a few songs I really like that are pretty obscure:

I want to touch you - Catherine Wheel
Tears - The Chameleons
Grimly Fiendish - The Damned

I'd love it if people could post their own lists of songs they like that aren't very well known. They don't have to be old either, I'm just interested to find some more good tunes to add to my collection :)