I had a lot of these cause a ton of trouble last season.
I would advise strongly against spraying anything this late in flower.
Especially with the open wounds the caterpillars are making and your flower is already quite solid and any moisture that gets inside will stay there for a while and add to the bud rot the caterpillars are already causing.
Scouting is difficult, but a safer way to go. They tend to like digging into the bud and then eat the stalk and is difficult to find them inside the flowers without manhandling your plants.
The parts where damage has been done (2nd pic) will end up rotting, so unfortunately the best thing to do is chop them before the mold spreads to other parts of the plant.
Either way, these guys are difficult to deal with and you will probably lose a big portion of your crop.