OpenAI flags reliability issues in SWE-Bench Pro benchmark

A new OpenAI analysis identifies issues with SWE-Bench Pro, a widely used coding benchmark for evaluating AI models. The analysis raises concerns about the benchmark's reliability and accuracy for comparing model coding performance.

Why it matters: Benchmark reliability directly affects how trustworthy coding-model leaderboards and comparisons are.