Nope.
My peppers are home to all manner of bugs and critters. I'm not going to nuke the entire micro-ecosystem on account of two individuals and 3 damaged leaves.
As with hornworms, if they multiply to the point that they're damaging the plant, I'll pluck them.