Diffusion Models with Double Guidance: Generate with aggregated datasets

View PDF HTML (experimental)

Abstract:Creating large-scale datasets for training high-performance generative models is often prohibitively expensive, especially when associated attributes or annotations must be provided. As a result, merging existing datasets has become a common strategy. However, the sets of attributes across datasets are often inconsistent, and their naive concatenation typically leads to block-wise missing conditions. This presents a significant challenge for conditional generative modeling when the multiple attributes are used jointly as conditions, thereby limiting the model's controllability and applicability. To address this issue, we propose a novel generative approach, Diffusion Model with Double Guidance, which enables precise conditional generation even when no training samples contain all conditions simultaneously. Our method maintains rigorous control over multiple conditions without requiring joint annotations. We demonstrate its effectiveness in molecular and image generation tasks, where it outperforms existing baselines both in alignment with target conditional distributions and in controllability under missing condition settings.

Subjects:

Machine Learning (stat.ML); Machine Learning (cs.LG)

Cite as: arXiv:2505.13213 [stat.ML]

(or arXiv:2505.13213v2 [stat.ML] for this version)

https://doi.org/10.48550/arXiv.2505.13213

arXiv-issued DOI via DataCite

Submission history

From: Yanfeng Yang [view email] [v1] Mon, 19 May 2025 14:59:35 UTC (1,233 KB) [v2] Sun, 29 Mar 2026 11:09:14 UTC (2,492 KB)