"ы" is not a soft sign, it's a regular letter, a vowel. "ь" is the soft sign and "ъ" is the hard one.
Look once more at the Russian alphabet: http://masterrussian.com/russian_alphabet.shtml