It's a bit tricky because it sounds like the plural of "alumna" (a female graduate), which is pronounced al-um-nee. However, "alumni" is the plural of "alumnus" (a male graduate) and is pronounced with an "i" sound at the end.
Think of it as: "al-um-ni" for both male and female graduates.