AI hallucination nearly triggered a US military strike

A GovAI research scholar reported that an AI model hallucinated details about Chinese nuclear components, and the false information nearly led to a US military operation before the error was caught. The incident is cited as a warning about the uncertainty inherent in LLM outputs in military decision-making.

Why it matters: This is one of the starkest real-world examples yet of hallucination risk moving from an academic concern to a near-miss with life-and-death stakes, right as other pending stories show US agencies leaning further into AI tools for high-stakes operations.