No he does. His memories don't come back until the end, but he straight up confronts her about it like within the next chapter or two. Hard to tell with novel to manhwa how long they take to tell some parts.
It's been a while since I read it but he figures out that's his daughter and everything. He's so sweet, marries Jeon super fast and you get lots of cute family moments with them.