Live intelligence

Latest AI updates

1 updates
Research

WaveGen: End-to-End Text-to-Waveform Diffusion Model with Internal Spectral Trajectory Learning

WaveGen is a fully end-to-end diffusion-based text-to-waveform model that eliminates external components like neural codecs, vocoders, duration predictors, and self-supervised embeddings. It uses a novel Spectral Forcing architecture with disentangled diffusion heads and a multi-scale spectral v-loss to jointly learn spectral and waveform trajectories. The model scales from 0.1B to 0.6B parameters and achieves state-of-the-art results on the Emilia dataset, with a WER of 1.47 and SIM of 0.75 on Seed-en. Source code and checkpoints are publicly available.

text-to-speechdiffusion modelsend-to-end generation