Back in Style: A Sociolinguistic Approach to Authoring and Measuring Persona Fidelity in User Simulation

As agentic systems gain commercial popularity, user simulators increasingly serve as measurement instrument for their evaluation. However, the fidelity of simulated users in comparison to real human users is generally low, and typically assessed by costly, subjective LLM judges.