The two dots above the "e" in "Zoe" are called an umlaut. In German, the umlaut changes the pronunciation of the vowel, but in English, it's mostly a stylistic choice and doesn't change the pronunciation.
Therefore, Zoe with the umlaut is pronounced the same as Zoe without it: "ZOE" (rhymes with "go").