The Shelf · Signal Library
No. 194

ServerBench: coding agents designing the LLM serving systems they run on

StrongEvidence grade
Nov 5, 2026Shelved
Agentic AISection
sha256:fd688d2a8a6e…Fingerprint

agents build complete, specialized serving systems against a "dollars per dollar" objective (latency-qualified token value per GPU dollar), with stateful replay and independent verification. Across 11 coding-agent models and three deployments, 22 of 33 runs produced verified systems and 13 beat the strongest baseline; the top run reached $2.97 per dollar, 4.87x the vLLM reference.

Read the source — arXivBrowse the Shelf

Cite as — Sawdust Shelf v2026-11-05.3 · No. 194 · fingerprint sha256:fd688d2a8a6e…
Share image rendered from the living shelf — the number, the grade and the fingerprint travel with the card.