Smash the caterpillers using the mallet as they pop up from their holes.