Я должна была вернуться город.

This is a bit confusing.

Why isn't this "....вернуться в городе." ?
The person is going in a direction, right?
I must be missing some important grammatical principle, or?