It's important to be mindful of the context and the speaker when using this term, as it can be seen as informal or even disrespectful in certain settings.
If you're unsure about the appropriate term to use, it's always best to err on the side of formality and use "south" instead.