I think basically some fixed phrases are the most difficult to translate; and cultural refferences.
Not to mention the obvious, that is specialized vocab. :P