It's important to remember that language is not a defining characteristic of a tribe or ethnic group. Often, different groups within a larger language family will have distinct dialects or variations in their speech, but they still share a common, understandable language.
Therefore, while the Ndwandwe may have had their own cultural traditions and practices, their language was isiZulu.