The Shelf · Signal Library
No. 161

Flide: an inference engine built for decision models like Jev

StrongEvidence grade
Nov 2, 2026Shelved
Agentic AISection
sha256:2f99d5a1b86e…Fingerprint

decision models (the paper names Jev explicitly) do lightweight categorical reasoning for agents, but generation-oriented engines waste it on prefix recomputation or distort output probabilities. Flide's ForkAttention forks exact state inside a single flattened token stream — every query branch evaluates identically to an isolated forward pass — and the paper reports queries up to 9.5× faster than vLLM and SGLang while staying closest to a float32 reference. Directly relevant: this engine's own decision pass runs on Jev.

Read the source — arXivBrowse the Shelf

Cite as — Sawdust Shelf v2026-11-05.3 · No. 161 · fingerprint sha256:2f99d5a1b86e…
Share image rendered from the living shelf — the number, the grade and the fingerprint travel with the card.