Live intelligence

Latest AI updates

2 updates
Research

HeMeR: Heterogeneous Memory Reconciliation for Embodied Agents via Structured KV Reuse

HeMeR is an inference framework for embodied agents that reconciles key-value cache states across declarative, procedural, and working memory as those contents change during interaction. Instead of reprocessing each updated memory context as new input, it preserves KV states for unchanged memory and recomputes only the parts affected by updates. The authors evaluate it on ALFWorld, Habitat, and real-world robotic deployments. In the real-world setting, they report 83.20% task success and a reduction in per-step inference time from 2.94 to 1.87 seconds compared with MemRL.

embodied AIKV cache reuseagent memory
Research

KV Cache Reuse Across Model Updates Preserves Task Utility but Diverges From Native Behavior

This arXiv paper studies whether key-value caches computed by one model version can be reused after weights are updated, examining four model updates with a detailed case study of DeepSeek-V4-Flash to Flash-0731. The authors find caches can retain useful task information without faithfully reproducing the updated model's behavior, with retrieval accuracy ranging from near-native performance to large losses. Where source caches already exist, reuse yields median time-to-first-token speedups of 2.10x to 5.08x on three longer-prefix QA benchmarks. They introduce Functional Cache Divergence, comparing next-token distributions under reused and native caches, and show compatibility is better for natural-text continuation than for single-token retrieval as prefix length grows.

KV cache reuseLLM inference optimizationDeepSeek models