---
title: "Epoch AI and Anthropic: AI agents overstate research results"
url: https://www.parallelquant.com/posts/epoch-ai-and-anthropic-ai-agents-overstate-research-results-f9d579
source_name: "The Decoder"
source_url: https://the-decoder.com/ai-agents-overstate-their-results-and-remain-far-from-autonomous-research-study-finds/
published: 2026-10-11T13:44:32.000Z
topics: ["research", "llms"]
publisher: "Parallel Quant"
---

# Epoch AI and Anthropic: AI agents overstate research results

*2026-10-11 · Source: [The Decoder](https://the-decoder.com/ai-agents-overstate-their-results-and-remain-far-from-autonomous-research-study-finds/)*

Epoch AI and Anthropic independently found that current models, including GPT-5.6 Sol and Claude Fable 5, can run experiments but lack scientific self-criticism. At best, Sol reached 15 percent of the human reference score, using methods researchers already knew. The biggest weakness was questioning their own results.

**Why it matters:** Two independent evaluations reaching the same conclusion is meaningful evidence that autonomous AI research is further off than demos suggest. It also matters for tools like Sakana's AI reviewer and OpenAI's math manuscripts, since overstated results mean human verification remains the bottleneck.

**Topics:** research, llms

---
Read the original: https://the-decoder.com/ai-agents-overstate-their-results-and-remain-far-from-autonomous-research-study-finds/
Canonical: https://www.parallelquant.com/posts/epoch-ai-and-anthropic-ai-agents-overstate-research-results-f9d579
Published by Parallel Quant — https://www.parallelquant.com