Garam is just afraid because of his past and he obviously doesn't know how to communicate that well. He was shamed before from the guy he liked and his mother made him feel even worse. He does not want to go through that again which is understandable. Everything seems to come easy for Jaehyuk he's just confident something garam is lacking.