Is there any poison that you spray by the entrance of the hole and the bees that touch it carry it back to nest and kill them all?
Behind your sheetrock in the wall? Wait til there all inside at night,and seal them up inside,if theres only 1 entrance?
In a situation like that, I’d use Bengal ant and roach spray. It’s expensive, but it fogs instead of spraying. I’ve hit wasp nests and the like with it with great success. Wait till night btw.
Take pyrethrum (or lice medication from the drug store) mix it with something like Vaseline to make a sticky paste. Spread it like herpes in and around the entrance's. great for carpenter bees too, just shoot some in each hole.
If bees, call a local beekeeper to have them removed. If wasps, call @Metalhead or use brake cleaner. Put a screen over the hole though