Adding underbelly weather protection, is it safe?

I think you’ll be fine just going over it. If it looks questionable to you just replace it before you cover it. Even if it should somehow develop a leak, there is normally nothing under the floor that has a spark. You could also pressure test it before you do anything a check for a leak.
It should be a fun project. Enjoy!