Here are a few ways you could imagine a horse expressing "yay":
* Neighing loudly and excitedly
* Stomping their hooves
* Snorting and blowing air out their nostrils
* Whickering and pawing the ground
* Head tossing and jumping around
So, while a horse can't spell "yay", they can definitely show us they are happy and excited with their own unique language!