The meaning of that sentence can be translated as:

"It wouldn't have killed him to stop by at my place."

Of course, the literal translation is different and much more vulgar as gRomoZeka mentioned.