retrieval augmented generation2 min read
Better Retrievers, Worse Labels: How Incomplete Relevance Judgments Distort Abstention Evaluation in Conversational RAG
Conversational RAG benchmarks such as MTRAG and RETECO evaluate retrieval and generation end to end: each system answers from its own retrieval, so abstention must be scored against whether each retrieved context is sufficient.
By Ivan Kochergin, Vasily KonovalovarXiv - cs.CL (NLP)
Read the full story
Originally published by arXiv - cs.CL (NLP) on Nov 2, 2026.
Comments
Sign in to join the discussion.