Helping disabled wife and the law? Rest area sign.

OP. You are just fine. It's the lady who is crazy. And apparently you are/were in a "traditional" state 'cause many states now days, in order to not be protested or boycotted have gender neutral bathrooms. All you have to do if ever confronted with an idiot like that lady again is to tell her that you identify yourself as a female and tell her to go take a hike.