Live intelligence

Latest AI updates

2 updates
Research

HiUni: A Unified Multimodal Model Sharing One Backbone for Understanding and Generation

HiUni is a unified multimodal model that reuses the same language-aligned ViT and dense Transformer backbone for both visual understanding and image generation, confining task-specific computation to the output side. To handle pixel-space optimization and the loss of fine spatial detail in pretrained ViT features, it introduces a Pixel Diffusion Head and a lightweight HiGate pathway. Experiments report an average understanding score similar to the pretrained VLM while achieving competitive image generation and editing performance. The authors argue a single dense backbone can support both capabilities without task-specific backbone computation.

unified multimodal modelsvision-language modelsimage generation
Research Editor selected

Prism: Bidirectional Self-Teaching for Unified Multimodal Models

Prism is a post-training method for unified multimodal models that derives bidirectional supervision from self-generated interleaved rollouts)Skip. It decouples trajectories into text and image chains, assesses their reliability, and constructs training targets accordingly. Experiments on SenseNova-U1 and BAGEL show improvements in both generation and understanding, e.g., GenEval +3.4 and MME +29 points, without external verifiers or annotated corrections.

Why it matters: This presents a novel training method with concrete benchmark gains, offering practical value for multimodal model development.

Unified Multimodal ModelsSelf-supervised LearningModel Post-training