The words that can be used as antonyms for "patted the back" include derogatory phrases or actions, such as "scolded," "criticized," or "blamed." "Punched" or "slapped" can also be antonyms, implying aggression rather than encouragement. Alternatively, words like "ignored" or "neglected" may suggest a lack of recognition or support. Further, phrases like "turned away" or "avoided" can connote a deliberate distancing from others. Overall, antonyms for "patted the back" imply negative action or lack thereof, rather than a positive demonstration of encouragement or support.