You never said which panels or controller, but given the controller limitations, sounds like you did it right.
Seems you're using 72 cell panels. Yeah, those can go over 50V open circuit per when you go below freezing. If you're using full power, they'd normally run at around 37V/9A.
They're considered 24 volt panels. There are also 60 cell panels, which are considered 20 volts, but are sometimes called 24 volt ones just to distinguish them from 12 V panels. It's confusing.
36 cell = "12 volt" = ~22.5 Voc
60 cell = "20 or 24 volt" = ~37.5 Voc
72 cell = "24 volt" = ~45 Voc
