Research
Asuka-FM: Efficient Text-to-Image Pretraining on a Single Consumer GPU
Asuka-FM is an end-to-end system and architectural framework for pretraining dual-stream Diffusion Transformers from scratch on a single consumer GPU. It combines an AdaLN-free backbone, Sparse-Dense Residual Fusion to cut attention FLOPs by over 50%, aspect-normalized RoPE with shifted square crop training, and a lightweight Patch Detailer Head for pixel adaptation. The authors report pretraining a ~206M-parameter model in ~160 GPU hours for under $55, with GenEval and DPG scores at 256px and 512px without benchmark-specific fine-tuning.
text-to-imagediffusion modelsefficient training