ProtoDiffusion: Token-per-Layer Generative Modeling of Multi-Layer Images
ProtoDiffusion is a latent-diffusion framework built on ProtoVAE, a multi-layer variational autoencoder that encodes a design into one shared spatial prototype plus one candidate vector per layer. This yields HW+N tokens for N layers before backbone packing, compared with NHW for full-grid-per-layer representations. The model jointly denoises the prototype and a fixed set of candidate slots conditioned on an image or text, with bounding boxes as optional layout guidance, and supports both image-to-design and text-to-design. Reported results include 40.43 dB PSNR on layer crops, image-to-design RGB L1 scores of 0.040 with boxes and 0.057 without, and text-to-design FID of 66.41 versus 86.84 for FLUX.2 [klein], while running 19.1x faster than a generation-then-decomposition cascade.
It introduces a more compact latent representation for layered graphic-design generation and reports concrete reconstruction, layout and text-to-design benchmark results.
Comments & Questions (0)
No comments yet
Be the first to comment!