Here's why:
* Bother is a verb that describes the act of causing someone to be worried or upset.
* Annoyance is the state of being worried or upset, which is the abstract concept associated with the verb "bother."
Here's an example:
* Verb: He bothered me with his constant questions.
* Abstract Noun: I felt a great deal of annoyance after his constant questions.