There is a phrase "проявлять преступную халатность",
I think it's very close to "neglect one's duties"