Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation

View PDF HTML (experimental)

Abstract:Flow matching has emerged as a promising framework for training generative models, demonstrating impressive empirical performance while offering relative ease of training compared to diffusion-based models. However, this method still requires numerous function evaluations in the sampling process. To address these limitations, we introduce a self-corrected flow distillation method that effectively integrates consistency models and adversarial training within the flow-matching framework. This work is a pioneer in achieving consistent generation quality in both few-step and one-step sampling. Our extensive experiments validate the effectiveness of our method, yielding superior results both quantitatively and qualitatively on CelebA-HQ and zero-shot benchmarks on the COCO dataset. Our implementation is released at this https URL.

Comments: Accepted to AAAI 2025. Code: this https URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2412.16906 [cs.CV]

(or arXiv:2412.16906v3 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2412.16906

arXiv-issued DOI via DataCite

Submission history

From: Hao Phung [view email] [v1] Sun, 22 Dec 2024 07:48:49 UTC (18,159 KB) [v2] Tue, 25 Mar 2025 03:47:02 UTC (20,363 KB) [v3] Sun, 29 Mar 2026 16:17:17 UTC (15,100 KB)