Its not the damaged leaves that will cause you trouble but whatever is eating your plant if you don't handle your pest issue.

Have you taken steps to prevent future pest dmg? If not it is a good idea. But like your question asked that one leaf won't set back the plant much. Just prevent from now on. Neem oil is my go too with an Insecticidal soap mix. Happy Growing! 🤟😜

I'm sure after this leaf falls off, the next one will soon be attacked and have holes in it! 😎

ohhh yesss... this can eat your plant! 😞 Use neem oil, the pests will go away in 3-10 applications! Usually, the pest control methods don't work the first time. You need to reapply for the proper effect and to solidify it! 👆 Good luck in the fight, friend! ✊😎

Nope. That leaf would fall off soon anyway. Put it in the back of your mind or just pluck it imo. Happy Growing! 🤟😜