SkillEval2 min read
SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models
Current evaluation of LLMs on benchmarks typically aggregates performance over individual examples into a single scalar score. This approach is overly coarse and ignores the diverse scope of skills covered by benchmark datasets.
By Berke Arda, Peng Cui, Qiaoyuan Zheng, Rudolf Debelak, Mubashara Akhtar, Mrinmaya SachanarXiv - cs.CL (NLP)
Read the full story
Originally published by arXiv - cs.CL (NLP) on Oct 22, 2026.
Comments
Sign in to join the discussion.