avan, when we were shopping last year for a TT, it was a similar experience except we were shopping factory new on the lot. I made it clear, for the right camper at the right price we'd come and get it. I can list of a dozen dealers that just dropped it once they heard we'd be coming from distance for it. I was stunned by it really because like you, no trade and we were prepared for cash and carry.
On the flip side, it helped us really narrow down our choices quickly and the quality dealers soon presented themselves because they understood some of us buy from a distance, negotiate by email, etc. They "got it" and so one of them got our business and we actually got a stellar deal too. My point is, like other, don't give them a second thought if they cannot be bothered to earn your business.