Mixture-Model Preference Learning for Many-Objective Bayesian Optimization

View PDF HTML (experimental)

Abstract:Preference-based many-objective optimization faces two obstacles: an expanding space of trade-offs and heterogeneous, context-dependent human value structures. Towards this, we propose a Bayesian framework that learns a small set of latent preference archetypes rather than assuming a single fixed utility function, modelling them as components of a Dirichlet-process mixture with uncertainty over both archetypes and their weights. To query efficiently, we designing hybrid queries that target information about (i) mode identity and (ii) within-mode trade-offs. Under mild assumptions, we provide a simple regret guarantee for the resulting mixture-aware Bayesian optimization procedure. Empirically, our method outperforms standard baselines on synthetic and real-world many-objective benchmarks, and mixture-aware diagnostics reveal structure that regret alone fails to capture.

Comments: 18 pages, 9 figures

Subjects:

Machine Learning (cs.LG); Machine Learning (stat.ML)

Cite as: arXiv:2603.28410 [cs.LG]

(or arXiv:2603.28410v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2603.28410

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Manisha Dubey [view email] [v1] Mon, 30 Mar 2026 13:18:43 UTC (2,526 KB)