parallelquant
November 21, 2026 · Tom's Hardware

Transformer compresses 1GB of Wikipedia to 105MB losslessly

Tufa Labs' tufazip compressed 1GB of Wikipedia to 105.39MB losslessly using a 163-million-parameter Transformer as its only predictor. It ran on two Nvidia B200 GPUs.

Why it matters: Compression and prediction are mathematically the same problem, so lossless Wikipedia benchmarks are a clean, hard-to-game measure of how well small models capture language. The result shows a compact neural predictor beating traditional hand-tuned compressors, though the GPU requirement keeps it a research milestone rather than a practical tool for now.

Related updates