Aww he's such a cute brother ,he does care for Damian but just maybe after his father had the brain surgery or something he did something evil or bad to him too to make him like that? Maybe , it's just an assumption. Because there's a lot of brain related stuff going on so I'm assuming something sad has happened for him to forget everything.