Maybe it's "Excusez mon anglais" by anology with "take French leave"? :) But that's only a guess.

I never knew that such expression existed in Russian but I'm almost sure that it originated from...