"I've been leaving already, because I've been here for a while."
However, this phrase is a bit awkward in English. A more natural way to say it would be:
"I've been wanting to leave for a while now, because I've been here for a long time."
The phrase implies that the speaker is ready to leave and has been waiting for a while to do so.