I've been there a couple of times and really like it there. Our son in law is from there. A few random observations:
Having lived in English Canada since 1973, I had often been told of the negative reaction there to English speakers. So I tested this out by speaking in my naturally very bad French or pretending to have no French. Made no difference! Everyone was very helpful and patient, whether we were in the touristy 'Old City' or across the river in Levis, where less English was spoken.
In the Old City, I was amazed to see an old cannonball stuck in the roots of a tree. I can't remember if this was from the war with the French or when Canada was invaded, unsuccessfully I may add, from the south.
The other thing I noticed was the large number of places that sold, or maybe rented, Mediaeval costumes. Apparently, this is due to the large numbers of festivals that they hold there.
Probably for the same reason, there were many places that sold reproduction mediaeval weapons and also toy 'knights' ! It was fascinating to see.