Resealing complete!
After hours of scraping and rubbing off the old sealant which also took a bit of paint off here and there as well (oops!), I used mineral spirits to do a final clean of all the areas around the windows. Lots of dirt and gunk game off so I’m glad I did!
I loaded up my caulking gun with ProFlex RV sealant. Everything I read recommended using it for RV/Van sealing. I bought two tubes at an RV repair place close by (most RV places have it, did not find it at any Home Depot or other home hardware type stores).
I caulked on smaller sections at a time then dipped my fingers in soapy water to help smooth it out (prevents it from sticking to my fingers). Worked like a charm and got it all done with only one tube!
Hopefully I won’t have to do that again for a long while! Rather labour intensive…