Him having a really shi*** life and going through hardships he didn't deserve doesn't negate the fact that he hurt Kim Dan on multiple occasions. It's just not right to justify one bad with another.
Do I sympathise with him, yes
but that doesn't make what he did okay or fine in any wa