While "hermit" refers to the person, "hermitage" refers to the state of being a hermit, or the place where a hermit lives.