I'm not 100% sure, but I think "with" is used in a sense of "by", similar to: "I'm fed up with what you're doing." Does that make sense?