Correspondere means "to answer, to agree, to be in harmony." It's made up of the prefix "cor-" meaning "together" and the verb "respondere" meaning "to answer".
This reflects the core meaning of "correspond" - to be in agreement or to answer something, whether it's a letter, a question, or a general idea.