It's a bit tricky because the "re-" is combined with the root word "fuge," which is a shortened form of the Latin word "fugere" meaning "to flee." So, the full breakdown would be:
* re- (prefix meaning "back" or "again") + fuge (shortened form of "fugere")
The word "refuge" literally means "to flee back" or "to go back to a safe place".