It describes a verb, adjective, or other adverb, indicating the beginning or source of something.
For example:
* Originally, I wanted to be a doctor. (Describing the verb "wanted")
* The originally white walls were now covered in paint splatters. (Describing the adjective "white")
* She was originally from California, but now lives in New York. (Describing the adverb "from")