It's likely you are thinking about the Pilgrims who sailed on the Mayflower to Plymouth, Massachusetts in 1620. The Pilgrims primarily spoke English, though some may have had some knowledge of other languages.
However, it is important to remember that the English spoken by the Pilgrims was quite different from modern English. It included older words and grammatical structures that are no longer in common use.