Боб, haven't you noticed, that phrase "в четыре утра" could be heard more often than "в четыре ночи"?
And it is very unlikely to encounter "в пять часов ночи"?
I agree, of course, that there is no clear boundary.