Interesting thing you bring up. The по + noun here can be translated as " NOUN apiece" or "NOUN each".
Каждый из учеников получил по книге. The students got a book apiece. Or one book each. But...