You can pick up a champion 2000 inverter generator for approximately $500. Even with solar you'll probably want a generator of some sort so as mentioned, it's probably a good option for part time off grid use.
As for solar cost, I can't say for installation as I did all mine myself, but for parts I'm almost right at $3000 dollars for 10 X 100 watt grape panels for a thousand watts total. Timetric 2030 controlling 2 SC2030 charge controllers, 600 watt and 2000 watt pure sine wave inverters with remotes, 2 auto transfer switches and an isolation relay for the converter, 2 home made combiner boxes, fuses, switches and wiring, and 4X6 volt 230 amp hour flooded golf cart batteries. I fabricated all the brackets myself, made the battery box out of a tote, and had some of the wiring and hardware on hand.