@RSL The only person he cares about is Libe, and he literally just threatened him not to lay a finger on her. He's just a tired man who's had enough of playing the hero.
Going against him would endanger Libe, unlike simply focusing on protecting her (that's how I understand it).