The Hidden Drivers of HRM's Performance on ARC-AGI
We scored on hidden tasks, ran ablations, and found that performance from the Hierarchical Reasoning Model comes from an unexpected source
38 stories
We scored on hidden tasks, ran ablations, and found that performance from the Hierarchical Reasoning Model comes from an unexpected source
Last week, the White House released its AI Action Plan. We’re encouraged to see the White House take transparency and measurement seriously as catalysts for AI progress.
Technical context and description of the ARC-AGI-2 Benchmark
Former ARC researcher David Matolcsi has put together a sequence of posts that explores ARC's big-picture vision for our research and examines several obstacles that we face. We think these posts will be useful to readers who are interested in digging into the details of our big-
ARC Prize Foundation is a nonprofit committed to serving as the North Star for AGI by building open reasoning benchmarks that highlight the gap between what’s easy for humans and hard for AI. The ARC‑AGI benchmark family is our primary tool to do this.
Measuring the next level of intelligence with ARC-AGI-2 and ARC Prize 2025
AI benchmarks generate ground truth about model capabilities and accelerate open progress
An experimental benchmark that measure LLMs in a snake battle
ARC Prize launched in 2024 as an experiment to promote the relatively obscure, but important, ARC-AGI benchmark. Now, after our OpenAI o3 testing, nearly everyone in tech has heard of it. But there is much more work to do to reach AGI.
OpenAI has released a new version of o3. Read our analysis to learn how it differs from the preview below.
Technical details on 2 state-of-the-art approaches to ARC-AGI.
Six months ago, we launched this crazy $1M experiment called ARC Prize to test an idea: are new ideas needed for AGI?
Deep learning is not enough to beat ARC Prize. We need something more. Knoop and Chollet lay out a path via Program Synthesis to beating the benchmark.
Over the last few months, ARC has released a number of pieces of research. While some of these can be independently motivated, there is also a more unified research vision behind them. The purpose of this post is to try to convey some of that vision and how our individual
This month, we visited 13 US universities to connect with AI researchers, discuss AGI progress, and inspire more people to participate in ARC Prize.
ARC Prize is going on tour, visiting over a dozen US universities and enlisting top AI students and researchers to actively move open AGI progress forward.
ARC Prize is a nonprofit dedicated to advancing open artificial general intelligence (AGI).
UPDATE: the full version of o1 was released December 5, 2024, important updates here.
Showing 36 of 38 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts