Do the windows too for sure. I saw Reddog1's leak and the window... Read below about tightening the new windows a bit when the rig is new or if you replace the calking seal of the window.
They are not easy to get the old Butyl tape to release. A careful application of heat from a heat gun will help soften if needed. Then using putty knifes and screwdrivers to gently pry the windows away.
When reinstalling the windows put them into position without any tape applied and see if the window will sit flush in the opening. The frame and glass is pretty ridiged so if it does not fit use extra tape. I had one window in my Bigfoot that did not fit flush. It was leaking from the factory!
That window was the passenger rear window.
When screwing the window in place do not tighten the screws all the way down. Tighten them down like torquing a rim or the head on a motor. Do the final tightening watching the Butyl Tape as it begins to ooze out from the frame. Make sure it ooze's out all the way around. Once it has oozed a 1/16" or so all the way around that is enough tightening.
After about 3-6 mos you should go around and give the screws about a 1/2 -1 turn depending on how tight they feel. Everyone should do this on a new camper! You may have to do it again after about a year or so. If you do this a couple of times your windows will never leak.
Trim the excess Butyl tape carefully with a razor.
Jim