LectureRechercheRadarCadre d'investissement
Connexion / Inscription
← Retour à la lecture
ActualitésMatériel2 min de lectureRédaction DisconfirmAI

Tufa Labs' tufazip compresses 1GB of Wikipedia to 105.39MB losslessly using a neural network alone

A new AI-based text compression method achieves the best result on the Large Text Compression Benchmark for pure neural predictors, but requires massive compute resources.

2026-11-21

Researcher Tommy He from Tufa Labs has developed 'tufazip', a self-learning AI transformer model that losslessly compressed 1GB of Wikipedia data into just 105.39MB. According to a research post published on November 19, 2026, this is the smallest result achieved on the Large Text Compression Benchmark by any entry that uses a neural network as its sole predictor. All entries ranking above it mix transformers with hand-built models.

The method relies on a 163-million-parameter Transformer model acting as a predictor. Unlike traditional chatbots or cloud AI, tufazip is a self-contained language model that learns on the fly during the compression process. Training occurs in two stages: an offline pre-trained starter model (4.33MB) and an online learning phase where the full model predicts each token and updates itself deterministically. The total file size includes the compressed text, the unpacking program, and the starter model, but not the fully trained weights.

However, the computational cost is extremely high. Compressing or decompressing the 105.39MB file requires two Nvidia B200 GPUs and takes approximately one week (about 7.3 days for compression and 7.5 days for decompression). This makes it impractical for general use compared to standard tools like WinRAR, positioning it strictly as a research achievement rather than a commercial product.

The experiment highlights interesting trade-offs in AI model design. For instance, a smaller 4K-word tokenizer outperformed larger 8K and 16K versions, and a 188-million-parameter model slightly beat a 267-million-parameter one on this dataset. Widening the training window from 15 to 35 million tokens only improved payload size by 1.21% while increasing compute costs by 40%. These findings suggest that optimization in neural compression involves complex balances between predictive quality, model size, and resource expenditure.

Connexion / Inscription
LectureRechercheRadarCadre d'investissement

Sources

  • tomshardware.comTom's Hardware↗
Continuer la recherche →