No idea what it is, the only story with an overworked butler I know of (but the lady he works for doesn't bully him, though his parents do in the closing arcs) is Hayate No Gotoku!
If you aren't able to get your answer, try asking on the manga subgroup on reddit. Folks there are generally able to find the title with even the vaguest descriptions