Yeah, like basusero said, "I give a damn" would really only ever be used to contradict someone's claim that they don't give a damn. It wouldn't really just develop on its own.