Live intelligence

Latest AI updates

7 updates
Research

EgoX: Egocentric Cross-Embodiment Manipulation with Embodiment Dreaming

EgoX is an egocentric cross-embodiment learning framework designed to combine demonstrations from humans, real robots, and simulated agents despite differences in morphology, sensing, and control. It pretrains a Modularized Cross-Embodiment Transformer with Embodiment Dreaming (MXT+) using modality-specific tokenizers and action experts over a shared Transformer trunk, then fine-tunes on target-embodiment demonstrations. A training-only dreaming objective predicts latent future visual and proprioceptive states. Across 13 task-embodiment pairs spanning five tasks and six embodiments, cross-embodiment pretraining raised average normalized task progress from 0.63 to 0.80, and from 0.53 to 0.77 under out-of-distribution conditions.

EgoXcross-embodiment learningrobot manipulation
Research

SALA Aligns Latent Actions Across Human and Robot Video for Embodied Foundation Models

SALA introduces semantically aligned latent actions to improve cross-embodiment learning for embodied foundation models. Without paired data, it uses language descriptions of unpaired human and robot clips to estimate semantic similarities and supervise correspondence between human and robot latent actions. Soft neighborhood structures guide human latent actions toward semantically related robot latents, while robot action reconstruction grounds the shared latent space in control. The method claims dual-axis scaling: more general human video for pre-training reduces robot action prediction error, and more task-specific human video for post-training improves real-world robot task success rates.

embodied foundation modelslatent action modelscross-embodiment learning
Research

SURE: Spatiotemporal Uncertainty Representation for Efficient Vision-Language-Action Learning

SURE is a data-efficient training framework for vision-language-action policies that explicitly models spatial and temporal uncertainty in manipulation demonstrations. It adds a lightweight transposed-convolutional probabilistic action decoder to capture spatial uncertainty among neighboring action bins and uses Soft-DTW alignment supervision to accommodate local timing variations. The method is evaluated on LIBERO, RoboTwin 2.0, and real-world manipulation tasks, where it matches or surpasses baseline VLA success rates using only 10% of demonstration data or 20% of training steps.

Vision-language-action policiesRobot manipulationUncertainty modeling
Research Editor selected

On Agentic Manipulation Policies

A new arXiv paper analyzes agentic manipulation policies (AMPs), where a generalist AI model directly commands a robot manipulator and adapts actions as tasks unfold. The authors present AMP1, a reference harness that runs unchanged across single-arm, bimanual, and mobile manipulation without demonstrations or task-specific training. AMP1 reports 85.6% zero-shot success on RoboLab-120 versus 49.2% and 42.9% for leading VLA and WAM policies, and succeeds in 104 of 108 real-world trials across twelve tasks and three robot instances. Adding a persistent memory store lowers failure rates on RoboDojo bimanual tasks by 4.6x relative to zero-shot deployment.

Why it matters: It provides concrete benchmark and real-world evidence that generalist agentic control can outperform specialist robot manipulation policies.

robot manipulationagentic AIvision-language-action models
Research Editor selected

Geometric Abstraction Reduces Multimodal Queries in Agentic Robot Policies

This paper proposes replacing step-by-step visual reasoning in multimodal robot policies with a 3D geometric abstraction that converts scene geometry into typed, evidence-aware symbolic references grounded from RGB-D data. The system refreshes metric values locally and returns compact textual checkpoints after each action, invoking direct visual reasoning only on demand. Experiments show improved multi-step manipulation completion while substantially reducing repeated multimodal queries.

Why it matters: Offers a concrete method to improve efficiency and reliability of agentic robot policies by using geometric abstraction, relevant to AI-driven robotics.

robot manipulationmultimodal language modelsgeometric reasoning
Research Editor selected

Asynchronous Robot Policy decouples VLM reasoning from fast action control

ARP is an architectural framework that separates high-capacity VLM semantic reasoning from lightweight action generation using asynchronous processes at different frequencies. It updates a semantic memory at low frequency while a Vision-Action Expert generates actions at high frequency, trained to handle staleness and execution delay. On Franka tasks, ARP improves success rate by 18%, reduces execution time by 20%, and achieves 3-5x baseline performance in dynamic simulations, while allowing the VLM to run at 10x lower frequency without significant loss.

Why it matters: This is a concrete architectural advance addressing the latency-reactivity tradeoff in VLA robots, with clear quantitative gains and practical efficiency benefits.

robot manipulationvision-language-action modelsasynchronous processing
Models Editor selected

Kyutai Releases REKI, a 2.4B Vision-Language-Action Model with Cached Register Memory

Kyutai, with Inria and École des Ponts, has released REKI, a 2.4B-parameter vision-language-action model for robot manipulation that was pretrained only on public data. It pairs a Qwen3.5-2B backbone with a 200M-parameter flow-matching action expert, and adds memory through 32 learned register tokens cached over the last three frames rather than feeding past frames into the VLM. The authors report 90.4% on LIBERO-Plus and 65.8% on RoboTwin Clean2Rand, with plain-language controls cutting arm osc

Why it matters: It offers a concrete, openly released VLA and a cheap memory design that robotics practitioners can inspect, reproduce and finetune.

Kyutaivision-language-action modelsrobot manipulation