The Midianites worshipped false gods and influenced many Israelites do do the same.

Vex (harass), and smite (attack) them: for they vex you with their wiles, wherewith they have beguiled (deceived) you …. Numbers 25: 17, 18

In other words, go on offence!