LatentPort: Beyond KV Cache - Cross-Model Transfer of Recurrent Memory in Hybrid Language Models: A 4B-to-9B Hybrid-State Handoff Without Target Prefix Replay
Abstract
Can one language model hand its live memory to another without the receiver rereading the context? We demonstrate useful persistent hybrid-state transfer across one architecture-matched Qwen3.5 4B-to-9B sibling pair. To our knowledge, this is the first demonstrated cross-model handoff of persistent recurrent inference state between differently sized hybrid language models without target prefix replay. Translated attention KV alone leaves a large gap; adding the Gated DeltaNet (GDN) persistent-state package lowers teacher-forced negative log-likelihood (NLL), the average next-token log-loss, by 0.747 nats/token (95% paired document bootstrap CI [0.6921, 0.8047]), improving all 64 PG19 documents. Direct recurrent and convolution reuse outperforms the tested learned GDN maps, consistent with partial functional compatibility of persistent-state coordinates. A fresh component factorial selects translated KV with direct recurrent and convolution state. An additional 434,176-parameter correction improves that base on 64 fresh web documents: continuation loss is 0.076 nats/token above native 9B (excess NLL), Jensen-Shannon (JS) divergence is 0.022, and native context recovery (NCR) is 0.918. Corrected 9B significantly beats continued 4B inference while processing zero historical prefix tokens. Evidence covers one direction, one geometry-matched Base-model pair, and 4K teacher-forced continuation; the near-native gate failed, the 16K branch was not run, and free-generation equivalence and a general state interface remain unproven.
Community
Can one language model hand its live memory to another without the receiver rereading the context?
LatentPort tests this with a Qwen3.5 4B → 9B handoff. The 4B model processes a 4,096-token context, then transfers its inference state to the 9B model, including translated KV and the model's persistent recurrent hidden state.
The 9B model receives zero historical context tokens.
Full-state transfer improved all 64 PG19 documents over KV-only transfer, and the final corrected handoff recovered 91.8% of the native 9B prefix benefit while significantly outperforming continued 4B inference.
To my knowledge, this is the first demonstrated transfer of persistent recurrent inference state between differently sized hybrid language models without target-prefix replay.
The bigger question I'm interested in is whether models could eventually expose a state interface, allowing computation and memory to move directly between models instead of everything being converted back into tokens.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- DASC: Decay-Aware State Compression for Hybrid Linear-Attention Serving (2026)
- Tail-Replay: Escaping the Curse of Linear Attention in Prefix Caching for Hybrid LLMs (2026)
- Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models (2026)
- HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models (2026)
- On-Demand Attention: Language Models Know When to Recall (2026)
- Consolidator: Learning Persistent Routed Memory Across Context Boundaries (2026)
- RPMem: Learning Long-Term Recurrent Parametric Memory Across Sessions for LLM Agents (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.25053 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper