@Constellation OD after reading your situation I don't think that you really need to say anything to him, you had told him from the start that you did not like him and being friends would be fine. It was him that wanted to escalate things on his own. You don't really have to justify anything to him.