The Shelf · Signal Library
No. 195

CompressionBench: coding agents compressing LLMs, verified end to end

StrongEvidence grade
Nov 5, 2026Shelved
Agentic AISection
sha256:fac6b9555213…Fingerprint

given a checkpoint, a storage limit, and a time budget, agents construct compressed weights plus inference code, guided by perplexity feedback and checked by independent verification. 29 of 36 submissions passed verification; the best design per task averaged only a 3.4% perplexity increase over BF16 at 77.33% downstream accuracy versus 79.56% uncompressed — and generation/inference tests exposed failures that likelihood scores alone missed.

Read the source — arXivBrowse the Shelf

Cite as — Sawdust Shelf v2026-11-05.3 · No. 195 · fingerprint sha256:fac6b9555213…
Share image rendered from the living shelf — the number, the grade and the fingerprint travel with the card.