CA is right. It will work but it won't be optimal. I think you have some solar? don't remember.
Charging 2 different battery banks - wet and AGM - with the same solar charger is not a good idea because they have different setpoints. Unless your charger is so basic that doesn't allow adjusting setpoints and simply pumps same Absorb and Float no matter what battery. Though this can be TAD fixed by installing Trik-L-Charge.
Besides, you will be discharging 2 banks differently - one with fridge and another one with everything else. The charger will be either undercharging or overcharging one of the banks.
If you can't/won't make the bank with all same batteries, it's probably better to parallel 2 banks for all loads.