Is it correct to say: Allow me to apologize for infringing on your time.

And is it correct to use something like: taking your time.... ?