It's a tricky question. Some more examples:

Did you mean me or you? = Ты имел в виду меня или себя?

A: I like tea. = Я люблю чай.
B: Me too. = Я тоже.

Come and see me tomorrow. = Заходи ко мне завтра.

She wants me to come and see her tomorrow. = Она хочет, чтобы я зашёл к ней завтра.


It might be that it is best for you to remember every case rather than trying and understand the rules for such cases because it is quite difficult to frame the rules