My boyfriend took me to the
Flatiron Lounge on our second date, and it remains one of my favorite places in the city ( http://www.flatironlounge.com/), and probably the best cocktails around. It's really in Chelsea, not Midtown, but it's not far! And it shouldn't be crowded at that time of night.