In your case I really wouldn't worry about the handling too much since you're only going to drive it every so often - you're going to live in it way more than you're going to drive it, so pay more attention to the living in it considerations. The Class A is going to give you more of everything including work surface room for the two of you.
As a broad general statement, the Class A, especially a diesel (yes I own one) will handle better in the cross winds and truck winds because they're heavier. You'll also be able to tow a large more comfortable toad.
Bill