However, it's important to note:
* Fort Caroline was short-lived. It was captured and destroyed by the Spanish in 1565.
* The first permanent French settlement in North America is considered to be Quebec City, founded in 1608 by Samuel de Champlain.
So, depending on what you consider a "settlement", the answer could be either 1564 or 1608.