Honestly the kind of person the emperor is I don't really want him to be the male lead. Despite his traumatic past or whatever he has this is simply not acceptable. If he didn't have any mistress and didn't love the empress now but changes latest on its somewhat acceptable. But marrying someone when he has a mistress and shamelessly showcasing that is terrible thing for a ML.