OK, if you are still around...what I see is just excess sealant, probably Dicor or Proflex.
The manufacturer probably just used too much during the build of your unit. (sloppy, fast, and not uncommon in the RV industry)
Are you in a warm climate or parked in hot direct sun?
My opinion is that the windows do not need to be removed and that their integrity is not compromised. (you said they were not leaking)
Carefully scrap off the excess that is running out of the frame. A heat gun or hot hair dryer will make the process easier. You can clean up the residue with some paint thinner on a rag.