We had a mess of wasps get into the furnace. they came through the round exhaust hole (We have put screen material over those holes since.) Just saw a few flying in and out one day. Went inside and started the furnace - well, tried to start the furnace but it wouldn't start. (God is Good.)
Waited until dark. Took a heavy see-thru plastic bag, sprayed wasp spray inside the bag and secured it over the furnace exhaust vents. That was really tricky to get it tight up against the RV. We barely managed to get it secured and the wasps swarmed out of the furnace into the bag. It took two days for the noises to stop. They just kept coming and coming. They were hatching out from inside, I think. After four days we pulled the bag off and took the blower out of the furnace. There were two 5" dia wasp nests secured inside the blower. I am not kidding. The wasps were still hatching out of these as we dismantled the nests. They weren't in there over the winter. We full time in our MH. They built that during the summer when we didn't use our furnace.
So work at night - when all the wasps are in their nest.
Use a bag to cover the vent that's been sprayed with wasp spray.
Don't be in a hurry to remove that bag. The sunlight on that bag the next morning will help kill them but you should leave it alone a few days until "all the buzzing stops".
Wasps are able to sting more than once. Bee's sting and die.
You don't want to be stung. So be very careful. As soon as they sense
noise and movement they will come out of that nest so have a plan and work fast.