Я не завидую всем means "I don't envy everybody".
Then Я завидую не всем. Because you do envy someone but not everyone.