Tentatively Excited

Rob and I might be going to NYC for a long weekend in the end of April.
I keep thinking about all the places I want to visit again, and new places I want to go.
Does anyone have recommendations for our potential trip?  I am thinking off-beat, not too terribly expensive places to see, eat, drink, etc...