Word "да" has many meanings. It can be a particle, conjunction or interjection. Here it has an intensive function and should not be translated as "yes". What remains is "нет, наверное", which is translated literally: "probably not" or "rather not".