It's a combination of two Japanese words:
* Kara (空), meaning "empty" or "void"
* Oke (オーケストラ), short for "orchestra"
So, literally, "karaoke" means "empty orchestra." It refers to the fact that you are singing along to a pre-recorded backing track, rather than having a live orchestra.