Here's why:
* Trombone literally means "slide trombone" in French. The shape of the paper clip resembles a trombone, hence the name.
* Agrafe is another, less common translation, meaning "staple" or "clip."
So, while both "trombone" and "agrafe" can be used, trombone is the more common and widely understood term for "paper clip" in French.