Ai2's StateBench finds top AI models fall to 13% or lower when tracking long chains of changes
Ai2 has released StateBench, a benchmark for how well language models keep track of changing facts in long documents. Gemini 3.8 Flash, Claude Opus 5.5 and GPT-6 Sol and Luna dropped to 13% or lower on the hardest, longest tests.
