So far there's no scene of blaming his daughter for her mother's death. It looks to me his biggest mistake was neglecting his daughter due to her appearance reminding him of his beloved wife. But so far he does look like he cares since he looks forwards to her letters. It's also a plus that he hates his new wife and kid and treats them worse than the FL lo