Ok guys here is some spoiler that will change your perspective about this manwha:
Spoiler!
I read posts on Instagram from people who read the novel and they said the reason he does all this to him is because he raped him when he was young, even gang-raped him: The brown haired guy raped the black haired guy in the past.
Yup.