This can be a bit confusing, as many food words are feminine in French. However, "poivre" is an exception.