Here's why:
* Whoever is used as the subject of a verb. In this case, "whoever" is the subject of the verb "was."
* Whomever is used as the object of a verb or preposition. It would be correct if you were saying something like: "You talk to whomever they tell you to."
The complete sentence: You talk to whoever was inside.