with verbs of motion по has the notion of setting out, initiating the activity.
Он шел на почту. He was going to the post office.
Он пошел на почту. He's gone off to the post office.

In others,...