I dont think he ever lost his memory or that it was ever in the book (book readers correct me if I'm wrong)
But what I do know is that a lot of people were saying he did only because he called Leewon "lawyer" instead of his name, so for some reason people lost their sh** thinking it's weird that he'd do that and came to the conclusion that he'd only do so if he lost his memory smh