The position of the middle of the tongue makes the main difference. When pronouncing «рь», your tongue’s tip occupies the same place as with «р», but its middle part is risen upwards like for the [i] sound.