I think the phrase "приходи ко мне" is an equivalent of "come over".

You do not explicitly mean "come to me" just as you do not mean to position your counterpart "over" you (at least, that is not apparent in the original phrase).