You are probably confusing "своё" and "твоё".

Let's examine the single sentence first: "То, что своё, нас не минует". The sentence is speaking about "нас" (can I say it in English this way? "the...