It's an exclamation of surprise, amazement, or frustration, often used in a humorous way. It's a common phrase in Spanish-speaking cultures and has been popularized in American culture through movies and cartoons.
While the exact origin is unknown, it's thought to be derived from the Spanish phrase "Ay, ¡caramba!" which roughly translates to "Oh, my goodness!" or "Oh, dear!"