Here's why:
* High describes a quality or state of being elevated.
* Height is the noun that represents that abstract concept of elevation.
For example:
* "The building has a high ceiling." (adjective)
* "The height of the ceiling is impressive." (noun)