Prefixed verbs of motion often have multiple meanings. They usually have one direct meaning, and many figurative meanings.
The same is true for the English "phrasal verbs" (as to get on, to take off, to give out) - we (Russians) also have many difficulties with them.

Your two examples just illustrate two different usages of the same verb.
And there are others.

That's what my dictionary says:

отводить
отвести (вн.)
1. lead* (d.); take* (d.); (в сторону) take* / draw* aside (d.)
отводить войска назад — withdraw, или draw* off, the troops
отводить воду (из) — drain (d.)
2. (об ударе и т. п.) parry (d.); ward off (d.) (тж. перен.); (перен.) remove (d.)
отводить обвинение — reject an accusation
3. (о кандидате) reject (d.); юр. (о присяжных) challenge (d.)
4. (о земле, помещении) allot (d.); (землю под определённую с.-х. культуру) set* aside (d.)
♢ отводить роль — assign a part
отводить душу — unburden one's heart, pour out one's heart
отвести глаза — look aside
он не мог глаз отвести — he couldn't take his eyes off
отвести глаза кому-л. разг. — distract / divert smb.'s attention, take* smb. in