OpenAI's GPT-6 Astra Posts 98.6% on ARC-AGI-3, but Test Conditions and Opacity Cloud the Achievement
OpenAI claims GPT-6 Astra achieved 98.6% on the ARC-AGI-3 benchmark, a dramatic leap from the 7.8% posted by its predecessor GPT-5.6 Sol. However, undisclosed evaluation parameters and unclear methodology raise questions about what the score actually demonstrates.