Google Research: LLM factuality errors mostly stem from recall, not knowledge

A Google Research study argues that when large language models state incorrect facts, the underlying knowledge is often present in the model's parameters but fails to be retrieved correctly, likening it to "lost keys" rather than "empty shelves." The finding reframes hallucination-reduction efforts around improving recall mechanisms rather than only adding more training data.

Why it matters: This matters for how labs approach hallucination fixes: if the bottleneck is retrieval rather than missing knowledge, techniques like better prompting, retrieval-augmentation, or architectural changes to attention and memory could matter more than simply scaling up training data. It's a useful data point for anyone building factuality-sensitive AI products.