frontier agents average 95% task accuracy on perturbed-but-benign coding tasks, yet their safe success rate — task done, no unintended harm triggered — averages only 37%. Task-success metrics alone understate the risk of shell-access agents.
frontier agents average 95% task accuracy on perturbed-but-benign coding tasks, yet their safe success rate — task done, no unintended harm triggered — averages only 37%. Task-success metrics alone understate the risk of shell-access agents.
Cite as — Sawdust Shelf v2026-11-05.3 · No. 178 · fingerprint sha256:def3f8eaa216…
Share image rendered from the living shelf — the number, the grade and the fingerprint travel with the card.