In English it's rather "with him" in the sense of possession. "Of him" sounds like origin.