Yes, people do that all the time but only in informal conversations.

Examples:


I don't know > Don't know.
I think so > Think so. (Unless you're using it as a question and it's clear what...