It's likely you're thinking of a specific phrase that includes "your" which *does* have an origin, but you'd need to provide the full phrase for me to help you understand its history.
For example, if you were thinking of the phrase "Your call," then I could explain how it likely originated from the idea of making a decision, similar to someone placing a phone call.
Please clarify what phrase you are thinking of! 😄