parking facilities not required near New York City

I want to stop near NYC at the end of April of this year. I have checked RV parks and they are quite expensive. I really only want to park and take public transport to stay downtown for 2 or 3 nigh...