November 21, 2026 · Tom's Hardware
Transformer compresses 1GB of Wikipedia to 105MB losslessly
Tufa Labs' tufazip compressed 1GB of Wikipedia to 105.39MB losslessly using a 163-million-parameter Transformer as its only predictor. It ran on two Nvidia B200 GPUs.
Why it matters: Compression and prediction are mathematically the same problem, so lossless Wikipedia benchmarks are a clean, hard-to-game measure of how well small models capture language. The result shows a compact neural predictor beating traditional hand-tuned compressors, though the GPU requirement keeps it a research milestone rather than a practical tool for now.
Related updates
- ByteDance's open Axion 1.0 agent rivals top models with three training phasesNov 21
- Stanford posts all-human Riemann hypothesis proof hours after Anthropic's Claude claimNov 21
- Thinking Machines releases open Inkling 2 Mini, a looped model for laptopsNov 21
- Anthropic mathematician claims Riemann hypothesis proof with Claude's helpNov 20