It's an example of the significant influence that Old French had on the development of English. After the Norman Conquest in 1066, French became the language of the ruling class and therefore heavily influenced the vocabulary of English.
The Old French word "merci" comes from the Latin word "mercēdes", meaning "reward, thanks".