Removal of the anode rod has nothing to do with sulfur smell. That comes from anaerobic bacterial growth in the water, not from city water chemicals.
To get rid of it, you should drain the hot water tank, then dump a bottle of hydrogen peroxide into a hose, connected to any potable water source, then refill the hot water tank and all the water lines. Let it set overnight, and in the morning, flush the system out. You can certainly do this with bleach, too, but I prefer peroxide as it is easier to flush out the system than bleach.