the initial pronoun, the subject you can treat not just as ты, but ты сам, you yourself
and so both are declined

in the translated version it may look as 'With whom were you cheating on your own...