Here is a good voltage drop calculator if you don't have one.
Voltage Drop CalculatorWhile you don't want to undersize there are things to consider beyond what is the biggest wire that can be used. There are good reasons why most controllers don't accept wire bigger than #6. Here are some things to consider.
How much real estate do you have for panels?
What is the max wattage you plan for the future?
Will it be series, parallel or S/P?
What is the wire length from combiner box to controller?
What type of controller will you use (PWM or MPPT)?
What is the max current/voltage the controller can accept?
What is the max controller output without clipping?
Will you use one large controller or two smaller ones?
How many connections will there be in the circuit?
Difficulty in routing #4 wire as well as increased cost.
At some point the law of diminishing returns takes over. When other resistance points (connectors, splices, fuses, switches) in the circuit contribute as much or more than the wire, it makes little sense to continue to lower the resistance of the wire. Is a .25V drop worthy of pursuing over a .5V drop?
My real estate is maxed out with two 24V panels, 185W each. Actual voltage in warm temps is about 33V. I used #8 wire which was overkill as I could double the amount of panels if I had the room and still be close to 1% drop.