Live intelligence

Latest AI updates

1 updates
Research

SkimPrefill Uses a Small Model to Speed Up Long Multimodal Prefill

Researchers propose SkimPrefill, a method that lets a small hybrid model (Qwen3.5-0.8B) read a long interleaved image-text input first, with images at half resolution, and rank whole units using an early-layer attention head. The target model then receives only the top-ranked units as a shorter prompt. With 10% of input tokens kept, the method reports prefill speedups of 3.7x, 11.6x and 8.2x for Qwen3.5-9B, Gemma-4-12B and Qwen3-VL-32B respectively while maintaining average accuracy on MMLongBench at 128K tokens.

SkimPrefillvision-language modelsinference efficiency