Here's why:
* Proper nouns are specific names of people, places, or things (like "John", "London", or "Amazon"). They are always capitalized.
* Common nouns are general names for people, places, or things. They are not capitalized unless they start a sentence.
"Windowsill" is a common noun because it is a general name for a ledge below a window.