Buff up is a slang term that means to improve something or someone (usually physically). Its antonyms are words that describe the opposite meaning. For instance, let's take the word "weaken" meaning to reduce strength or energy. This would be the opposite of buffing up something or someone. Other antonyms for buff up could include weaken, deteriorate, soften, shrink. All of these words describe the decline or reduction of physical fitness or condition. So, if you're looking to convey a negative meaning of unimprovement, then these are some of the antonyms you could use for buff up.