Danger from charging golf cart inside toy hauler??

Yes! Without ventilation not only can the explosive gases buildup but those gases are also corrosive and will attack aluminum the worst but also other metals are favorite targets for those gases. You did the right thing by not leaving a charger on those batteries - especially if you're not using a "float" charger.

First to do is air it out real good before powering anything up.