Live intelligence

Latest AI updates

1 updates
Research Editor selected

Online Temporal Rotations for 2 Bit KV-Cache Quantization in Video Diffusion Transformers

The paper introduces Temporal Rotation Quantization (TRQ), which rotates temporally adjacent KV-cache vectors before quantization in video diffusion transformers. For each block of temporally adjacent cache vectors, TRQ fits an orthogonal transform that maps per-channel means toward a near-constant vector, parameterized as a tree of 2x2 planar rotations stored with two bits each plus a fixed shared Hadamard transform. The rotations are fit online per video without gradients or model weight changes, and the authors prove a greedy fit is globally optimal for their mean-flattening objective. At 2-bit precision and matched compression, TRQ improves VBench subject consistency over QVG from 90.38 to 92.02 on LongCat-Video-13B and from 86.33 to 87.61 on HY-WorldPlay-8B, with fused Triton kernels released for inference.

Why it matters: It offers a concrete, gradient-free 2-bit KV-cache quantization method with measured VBench gains and released kernels for long video generation.

KV-cache quantizationvideo diffusion transformersefficient inference