Here's how it breaks down:
* un-: A prefix meaning "not" or "the opposite of"
* ceremony: The root word, meaning a formal act or series of acts performed on a special occasion.
* -iously: A suffix that forms an adverb, meaning "in a manner characterized by"
Therefore, "unceremoniously" means "in a manner without ceremony" or "without formality."