Forward-Value Discretization Speeds Up Stochastic Diffusion Sampling
This arXiv paper analyzes why higher-order discretization does not generally improve the convergence order of stochastic diffusion samplers, establishing matching upper and worst-case lower bounds. It introduces forward-value discretization, a training-free framework that evaluates the model at a lookahead estimate built from previous predictions. The resulting F-DDPM adjusts the lookahead for subsequent noise injection and reuses prior model predictions and injected noise, with first-order convergence guarantees at one model evaluation per iteration. Across CIFAR-10, ImageNet, FFHQ, and LSUN, F-DDPM reports lower FID than evaluated stochastic baselines at matched NFE budgets.
It offers a practical, training-free sampling method that narrows the efficiency gap between stochastic and deterministic diffusion sampling.
Comments & Questions (0)
No comments yet
Be the first to comment!