IMHO (and I may be wrong), I think the sentence sounds much better with "ему-то" than with "ему".