Towards Automated Knowledge Transfer in Evolutionary Multitasking via Large Language Models

View PDF HTML (experimental)

Abstract:Evolutionary multi-task optimization (EMTO) is an advanced optimization paradigm that improves search efficiency by enabling knowledge transfer across multiple tasks solved in parallel. Accordingly, a broad range of knowledge transfer methods (KTMs) have been developed as integral components of EMTO algorithms, most of which are tailored to specific problem settings. However, the design of effective KTMs typically relies on substantial domain expertise and careful manual customization, as different EMTO scenarios require distinct transfer strategies to achieve performance gains. Meanwhile, recent advances in large language models (LLMs) have demonstrated strong capabilities in autonomous programming and algorithm synthesis, opening up new possibilities for automating the design of optimization solvers. Motivated by this, in this paper, we propose a Self-guided Knowledge Transfer Design (SKTD) framework that leverages LLMs to autonomously generate knowledge transfer methods (KTMs) as algorithmic components within EMTO. By enabling data-driven and self-adaptive construction of transfer strategies, SKTD facilitates effective knowledge reuse across heterogeneous tasks and diverse EMTO scenarios. To the best of our knowledge, this work represents the first attempt to automate the generation of KTMs for EMTO. Extensive experiments on well-established EMTO benchmarks with varying degrees of task similarity demonstrate that the proposed SKTD consistently achieves superior or highly competitive performance compared with both the state-of-the-art program search approach and manually designed EMTO methods, in terms of optimization effectiveness and cross-scenario generalization.

Comments: 25 pages

Subjects:

Neural and Evolutionary Computing (cs.NE)

Cite as: arXiv:2409.04270 [cs.NE]

(or arXiv:2409.04270v2 [cs.NE] for this version)

https://doi.org/10.48550/arXiv.2409.04270

arXiv-issued DOI via DataCite

Submission history

From: Yuxiao Huang [view email] [v1] Fri, 6 Sep 2024 13:25:43 UTC (3,180 KB) [v2] Tue, 31 Mar 2026 14:19:16 UTC (661 KB)