We have crossed into/out of Canada (Ontario and Quebec)about 4 times, and always had a passport rather than a special-cleared for Canada driver's license from Washington State. Never had a problem, oh, once the Canada/into U.S. crossing held us up for about 10 minutes while he did a "walk around" outside our "18-ft. weekender" and thought perhaps it was because the last time we had crossed into and out of Canada we were in a larger RV. No problems any time we have crossed into or out of Canada .. oh, the reason for the crossings was to see our son and his family, and that is/was always our reason for going into Canada.
We did have one that the motorhome in front of us had the "dog" inspection, then it was pulled over for a full-scale inspection. So maybe that is why we were allowed right in with only questions and checking our passport records.