For something that burns or corrodes:
* Corrosive
* Abrasive
* Etching
* Biting
* Sharp
* Acidic
For something that is sarcastic or biting:
* Sarcastic
* Acerbic
* Scathing
* Cutting
* Withering
* Mocking
* Ironic
* Cynical
For something that is critical or harsh:
* Critical
* Severe
* Harsh
* Unkind
* Bitter
* Scathing
The best synonym for "caustic" will depend on the specific situation and the nuance you want to convey.