I think you just have to be honest. Being honest is the best option, even if it hurts the other side. You shouldn't be with him just because your family loves him. If you don't really love him that much, it would be best for both of you to tell the truth and stop being lovers. Because as time passes, it will be more difficult to break up with your lover. (Sorry my english is not very good so i hope i explained it properly 🥲🥹😭)