What is the root word of unsmilling?

The root word of "unsmiling" is smile.

The prefix "un-" is added to the word "smile" to create the opposite meaning, meaning not smiling or having a serious expression.