I also never say "whom" and I'm unsure when to use it. You use it like "wem" in German, don't you? So basically "with whom/to whom" but "who did he kill" and not "whom did he kill"?
I've never heard anyone around this area say "whom" either. But we are rather uneducated down here.