Here's why:
* It modifies a verb: It tells us *how* something is done. For example: "He ordinarily wakes up early."
* It can also modify an adjective or another adverb: "It's ordinarily warm here." "She walks ordinarily fast."
Let me know if you'd like more examples!