I would agree that 50W is hardly worth the trouble. However, if I can acquire a panel cheap enough that extra 3ish amps makes a difference with limited optimal hours of sun. If I was certain that I could get away with it I would go for another 100w panel... My luck I would fry the controller and end up having to buy a new one... Actually, the 200W system doesn't do a bad job keeping things topped up (if my wife and kids don't plug in everything that needs charging at night using the inverter). For me it's just knowing that I have the ability to squeeze a few more amps that makes it tempting to add a panel.
As for installing a second cheap controller and or no controller with a switch... Thanks, but no... I would rather upgrade my current controller. While this might work just fine, I wouldn't be happy with it.