The Shelf · Signal Library
No. 185

When self-verification hurts — calibrated answer repair for financial QA

StrongEvidence grade
Nov 4, 2026Shelved
Agentic AISection
sha256:bc9f318b2867…Fingerprint

asking a model to verify and revise can damage answers that were already correct. Calibrated Answer Repair first estimates whether a draft will benefit from repair, then localizes the evidence and bounds the edit: across three financial-QA benchmarks and three open-weight models it recovers 14.6% of initially missed answer requirements while damaging only 2.1% of initially correct ones, at over 30% lower post-draft token cost than iterative revision.

Read the source — arXivBrowse the Shelf

Cite as — Sawdust Shelf v2026-11-05.3 · No. 185 · fingerprint sha256:bc9f318b2867…
Share image rendered from the living shelf — the number, the grade and the fingerprint travel with the card.