Water has a lot of mass, and takes a lot of time to cool down. Just think of the tiny amount of water in the cells of an ice tray in your freezer. It's 0 F in your freezer and it still takes hours to make ice.
Not sure where you're at, but in Michigan we're dipping below freezing for maybe an hour or two just before sunrise. That's not enough time to freeze water inside pipes, let alone holding tanks.
Best advice I would have for you, if you're in / near a farming community, the government will issue FROST and FREEZE advisories and warnings. If you get a freeze warning, that means extended times below freezing is likely, and you may want to take action to protect your plumbing.
In other words, it's not really how cold, but how long. A few hours before sunrise, no problem. If it's in the 30s when you go to bed at 11pm and expected to bottom out in the 20s by sunrise, then you might want to worry.