This term likely arose because of the association of cocaine with wealth and luxury, which in turn could be linked to high-society "ladies."
However, it's important to note that slang can vary significantly based on region, time, and social group. It's always best to be cautious when interpreting slang terms and to consider the specific context in which they are used.