...But why is it "беглая гласная"? Shouldn't it be "беглое гласное о" or "беглый гласный звук о"?
Yes, it is "буква". Actually in the standard pronunciation the sound here is "а" because preposition and the next word is usually pronounced as one word and the preposition is not stressed.