Lots of people do. I certainly do (in Vermont). I do have electricity at my storage location next to my garage, so the house battery is maintained by the PD converter.
If the battery is fully charged, it won't freeze until the temperature drops down to truly arctic conditions (somewhere around 90 degrees below zero IIRC). In cold conditions, the battery self-discharge is also greatly slowed. Because of these, it's also reasonable to charge the batteries (fully), and then disconnect them and leave them for the winter. In the springtime, they'd probably have self-discharged to maybe 75% or 80% charged, though it does of course depend on the conditions and the battery.
If they're in a warmer place, it's rather more important to use a battery tender or a periodic bit of charging to keep them from self-discharging too far.