Research
Discrete diffusion world model cuts inference cost while improving data efficiency
This arXiv paper proposes a two-stage discrete diffusion approach for world models, replacing next-token prediction with iterative masked predictions performed by a lightweight refinement transformer. Building on an existing autoregressive world model, it reports a 79x speed-up with a modest quality trade-off. It also shows that consistent gameplay can be reproduced using a dataset of approximately 28 hours of gameplay. The work targets real-time interactive play and ideation, where inference speed and data efficiency are critical.
world modelsdiffusion modelsreal-time inference