I have a number of Mexican neighbors que no hablan Inglés, and although I can read some elementary Spanish, I don't speak the language at all. And I have no interest in learning Spanish in order to socialize better with my Mexican neighbors; if they have something important to say to me, they can say it in the language of my country, which is the same language that my neighbors from Korea and Haiti and Lebanon have all had to struggle with, namely English. Or, if they don't want to learn English, they can f*ckin' study Russian, like I did, и потом мы с ними можем ме-е-е-едленно и по-тарзански разговарывать на языке, куда труднее чем английского или испанского! (Really, my spoken Russian is like Tarzan, and thus the Mexicans and I would be on equal footing!)
So I think that Latvians are perfectly entitled to say about their Russian-speaking minority: "Learn Latvian and raise your children to speak Latvian. Or, if you don't want to learn Latvian, then we can agree to talk in a language that's foreign to both of us, like English or German."