I was having the same problem with the tail wagging and so I have bought new Konis for the front end of my Class A as the fronts had 107 K on them. The other problem I had thought about was the same as the OP and that was that the tail was wagging the dog as the Trailblazer I was pulling had been in a front end wreck before I bought it and the RV dealer service man where I go said that the front end of it may be a bit loose and that would let the front end wander a bit.
Well,before I could get that taken care of,I kinda bought me a '11 Jeep Liberty to take it's place. Hopefully,that takes care of the wander problem. We'll see on the next trip what it feels like.
And yes,some of the ruts you'll find on any part of I-5 will tend to throw your toad around.