AgentCollab: A Self-Evaluation-Driven Collaboration Paradigm for Efficient LLM Agents

Authors:Wenbo Gao, Renxi Liu, Xian Wang, Fang Guo, Shuai Yang, Xi Chen, Hui-Ling Zhen, Hanting Chen, Weizhe Lin, Xiaosong Li, Yaoyuan Wang

View PDF HTML (experimental)

Abstract:Autonomous agents powered by large language models (LLMs) perform complex tasks through long-horizon reasoning and tool interaction, where a fundamental trade-off arises between execution efficiency and reasoning robustness. Models at different capability-cost levels offer complementary advantages: lower-cost models enable fast execution but may struggle on difficult reasoning segments, while stronger models provide more robust reasoning at higher computational cost. We present AgentCollab, a self-driven collaborative inference framework that dynamically coordinates models with different reasoning capacities during agent execution. Instead of relying on external routing modules, the framework uses the agent's own self-reflection signal to determine whether the current reasoning trajectory is making meaningful progress, and escalates control to a stronger reasoning tier only when necessary. To further stabilize long-horizon execution, we introduce a difficulty-aware cumulative escalation strategy that allocates additional reasoning budget based on recent failure signals. In our experiments, we instantiate this framework using a two-level small-large model setting. Experiments on diverse multi-step agent benchmarks show that AgentCollab consistently improves the accuracy-efficiency Pareto frontier of LLM agents.

Subjects:

Computation and Language (cs.CL)

Cite as: arXiv:2603.26034 [cs.CL]

(or arXiv:2603.26034v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2603.26034

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Wenbo Gao [view email] [v1] Fri, 27 Mar 2026 03:07:34 UTC (265 KB)