Here's why:
* Adverbs modify verbs, adjectives, or other adverbs. They describe how, when, where, or to what extent something happens.
* "Late" tells us *when* they arrived. It modifies the verb "arrived".
* "Their" is a possessive pronoun and indicates ownership. It doesn't describe the action of arriving.
Example: They arrived late for the party.