Ai2 Blog8 min read
Can we trust LLMs to judge whether a research idea is novel?
Old Ideas, Novel Problems tests how reliably LLMs judge the novelty of research ideas, finding that small changes to the evaluation setup can produce very different verdicts.
By Allen AI (AI2)

Read the full story
Originally published by Allen AI (AI2) on Oct 27, 2026.
Comments
Sign in to join the discussion.