Yellowstone National Park Scheduling

We are trying to schedule a trip to Yellowstone this year. We would like to go earlier in the season rather than later, but don't know when a good start date might be.

Is early to mid June usually too early? If so, what would be considered a good date to start a week stay? We would like some decent temperatures during the day, and above freezing at night.

Thanks for any insight.