Interesting thing you bring up. The по + noun here can be translated as " NOUN apiece" or "NOUN each".
Каждый из учеников получил по книге. The students got a book apiece. Or one book each. But funny that книга is not in the accusative. Notice you can't say Ученик получил по книге. Just as you can't say The student got a book apiece.