This is a fairly direct translation, but the nuance of the phrase could change depending on the context.
Here are some possibilities:
* "Actually, you get me." (more casual)
* "You actually know what I mean." (more formal)
* "You understand me, deep down." (more emotional)
It's best to consider the specific situation and the speaker's tone to determine the best translation.