We could say that все is a direct address, as in vocative constructions, while всем is the indirect object.