What's eating my leaves? It was a caterpillar all along!

Would something like Canncontrol from Mammoth work? Also, do I have to treat all the plants as well?