another caulk question

This is what the "caulk" if you will looks like. I'm not sure that it's caulk, as it seems to be more like a tape they apply which squeezed out. Should I gently trim this off with a knife and then ap...