Ach, hostels are absolutely fine. Just read the reviews from people who've stayed there previously on
www.hostelworld.com, they're usually fairly honest and accurate.
No idea about New York, but The Latin Quarter was a really nice place to stay in Paris. In fact, there's a free tour that leaves from there at 11am in front of the fountain at Place Saint-Michel.