Depends what time period you're asking about. Iron Monger put him through hell for the finer part of a decade. Justin Hammer caused the Armor Wars in the 90's. His problems were tied to Shield's major problems for a while. Norman Osborn screwed him out of everything after the Secret Invasion. Overall though, yeah, I'd have to say Mandarin for most frequent.
