I suppose you can find some more... "set" phrases with whom. Like "Many people went there, most of whom didn't know where they were." < this is considerable less bad. It would be taken as just "good writing".