It comes from the Proto-Germanic *merki, meaning "thanks, gratitude," which itself likely originated from a Proto-Indo-European root.
While Old English did borrow words from other languages, "merci" is an example of a word that originated within the Germanic family.