"Да" here doesn't mean "yes". It has some other meanings in Russian. It's like "well, OK, h-mm, but, and" etc.