@Bando
He is stuck where he is at the moment. The curses is what chains him down from deviating from the story. There is such a thing as a butterfly effect. If he doesn't meet certain conditions to be free of his curse, that opening may no longer be available ever again.
That's what it is set to.
it's been over a year and i'm still certain that he is forced to do this as he is under the most extreme level of difficulty when he got isekai-d in this world.
Also if he doesn't clear other quests, the numbered days he has remaining will not be extended. and he will die. Either his days are up or get killed in combat as he was unable to overcome the curses.
Like it or dislike it. You don't have to agree to everyone all the time. And that's OK.