Think of it like a cheer or a shout of celebration, often used in contexts like:
* Victories: "Huzzah! We won the game!"
* Good News: "Huzzah! We got the promotion!"
* Celebrations: "Huzzah! It's a holiday!"
It's also a common expression in historical fiction and fantasy settings, adding a bit of old-fashioned flair.