I'm quite sure that exception comes from old name of Ukrain - it used to be called not "Украина" but "Окраина", which means "the edge". So the natural preposition was "на" - "на окраине" ("on the...