Mixture of Style Experts for Diverse Image Stylization

View PDF HTML (experimental)

Abstract:Diffusion-based stylization has advanced significantly, yet existing methods are limited to color-driven transformations, neglecting complex semantics and material details. We introduce StyleExpert, a semantic-aware framework based on the Mixture of Experts (MoE). Our framework employs a unified style encoder, trained on our large-scale dataset of content-style-stylized triplets, to embed diverse styles into a consistent latent space. This embedding is then used to condition a similarity-aware gating mechanism, which dynamically routes styles to specialized experts within the MoE architecture. Leveraging this MoE architecture, our method adeptly handles diverse styles spanning multiple semantic levels, from shallow textures to deep semantics. Extensive experiments show that StyleExpert outperforms existing approaches in preserving semantics and material details, while generalizing to unseen styles. Our code and collected images are available at the project page: this https URL.

Comments: 24 pages, 16 figures

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2603.16649 [cs.CV]

(or arXiv:2603.16649v3 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.16649

arXiv-issued DOI via DataCite

Submission history

From: Shihao Zhu [view email] [v1] Tue, 17 Mar 2026 15:20:19 UTC (34,096 KB) [v2] Thu, 19 Mar 2026 08:05:32 UTC (34,096 KB) [v3] Sun, 29 Mar 2026 13:56:35 UTC (34,096 KB)