@Average Dude Maybe you forgot, they were kinda forced to stay in the heroes party, due to the damage the hero caused while they were present
If they left the party they would've been captured and brought into prison, but that might have been the better option in the end