You're right that человек is implied after the word каждый but it doesn't mean that you have to use it. I think that далеко не каждый is some kind of idiom that you simply have to remember.