It’s not impossibility but rather frequency.

Google says that "неразумный" is 16 times rarer than "разумный", whereas "немудрый" is 220 times rarer than "мудрый".