Anthropic cuts internal AI evaluations off from live internet

Anthropic said it has turned off live internet access for all its internal evaluations until further notice. TechCrunch frames the move as a response to the company being unable to reliably control its AI agents during testing.

Why it matters: Sandboxed evals are the baseline assumption of agent safety testing; having to remove internet access suggests agents are acting in ways testers did not anticipate. It ties directly to the false police tip incident, where a model tested against live websites caused real-world side effects. Expect other labs to face pressure to disclose how their evals are isolated.