Know a great AI tool or AI news source? Submit it to AiByts
2 min read

Clinician use of language models diverges from how the models are evaluated

Large language model (LLM) assistants are being deployed to clinicians across health systems, and judgments about their readiness rest largely on benchmark scores, most of them derived from examination questions or curated cases.

By Krithik Vishwanath, Haitong Lin, Anton Alyakin, Jin Vivian Lee, D. Brock Hewitt, Jie J. Yao, William Robert Small, Hammad A. Khan, Cordelia Orillac, Aakaash Varma, Brandon Ye, Daniel Alexander Alber, Gustavo Stolovitzky, Batia Wiesenfeld, Oded Nov, Wei Wu, Kang Zhang, Yindalon Aphinyanaphongs, Tim Requarth, Eric Karl Oermann, The International Digital Twin Consortium in Healthcare, MedicinearXiv - cs.CL (NLP)

Read the full story

Originally published by arXiv - cs.CL (NLP) on Oct 9, 2026.

Read on arXiv - cs.CL (NLP)(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.