It is more often used in "это не вашего ума дело" form.