What does the prefix of submerge mean?

It means "under" or "beneath".

So, "submerge" literally means "to place under" or "to cover with water".