February too cold for Williamsburg VA?

Kids have a day off in mid February. Was thinking of going to American Heritage rv park for 3 day weekend. Maybe walk around Williamsburg. We are only an hour or so away. Have only lived here for ...