The only thing that I can think of is "fly by night".

I don't like to business with "fly by night" company.

Perhaps someone else will come up with something better.