"For Pete's sake" is an expression often used to express frustration or exasperation. However, there are a few alternative phrases that can be used in its place. "For crying out loud" is a common substitute that has a similar level of intensity. Another option is "good grief," which is a bit more mild but still gets the point across. "Oh my goodness" is a gentler option that can be used in more formal settings. "Heavens to Betsy" and "holy cow" are more playful options that can be used in casual conversation. Ultimately, the choice of phrase will depend on the situation and the tone you wish to convey.