Controlling affairs is a task that requires a specific set of skills and abilities. However, there are situations where controlling affairs may not be appropriate or necessary. In these cases, it may be more suitable to use antonyms of the phrase "control affairs of." Some antonyms may include "lack of responsibility," "disorganization," "unmanaged," "uncontrolled," and "spontaneous." These antonyms suggest that the affairs are left to chance and not being managed in a systematic or organized manner. It's important to choose the right antonym based on the situation and the level of responsibility required of the individual or organization.