US laws must have changed recently. We were in Lewiston, NY (a border town) recently, just about ready to return to Canada, and needed some US money to make a purchase in a place that didn't accept credit cards. So I went to two banks. The conversations were similar in both.
Me: "I'd like to exchange some Canadian money for some US money"
Teller: "Do you have an account here?"
Me: "No"
Teller: "Sorry, I can't do it unless you have an account"
Me: "I'm Canadian. Why would I have an account here?"
Teller: "Sorry. These are the rules."
IMHO, you'll have no trouble exchanging your greenbacks at any of the places suggested by the respondents above. Now, as far as the situation in PEI is concerned, there are crooks everywhere. I would have taken my business elsewhere.