The phrase "throwing in one's lot with" is often used to describe making a commitment or aligning oneself with a particular cause or group. However, if you don't want to make such a commitment or are hesitant to align yourself with a particular group, there are a number of antonyms you could use instead. Some possible options might include terms like "keeping your distance," "keeping your options open," "staying neutral," "refraining from involvement," or "remaining independent." Ultimately, the decision about whether or not to throw in your lot with another group or cause is a personal one that depends on your own values, beliefs, and priorities.