The Shelf · Signal Library
No. 127

Google's sleep framework: wake/sleep cycles for continual learning

UnverifiedEvidence grade
Oct 29, 2026Shelved
Agentic AISection
sha256:90d238601e79…Fingerprint

instead of training once and freezing, the model alternates active interaction with an offline "sleep" phase that unlocks low-rank MoE memory blocks, distills fragile in-context memory into long-term parameters, prunes the temporary store, and rehearses filtered self-generated "dreams." Reported results: near-perfect long-context scaling up to 10M tokens on BABILong, near-zero performance drop in multi-stage continual translation where ICL and fine-tuning baselines suffered severe catastrophic forgetting, and 48.9% on SQuAD factual incorporation.

Read the source — Google ResearchBrowse the Shelf

Cite as — Sawdust Shelf v2026-11-05.3 · No. 127 · fingerprint sha256:90d238601e79…
Share image rendered from the living shelf — the number, the grade and the fingerprint travel with the card.