SkimPrefill Uses a Small Model to Speed Up Long Multimodal Prefill
Researchers propose SkimPrefill, a method that lets a small hybrid model (Qwen3.5-0.8B) read a long interleaved image-text input first, with images at half resolution, and rank whole units using an early-layer attention...