Live
Black Hat USAAI BusinessBlack Hat AsiaAI Businesshiggsfield brings art-directed quality to AI image generation at production scale - DesignboomGNews AI artWith an eye on China, Japan looks to kamikaze drones and low-cost missilesSCMP Tech (Asia AI)Passive Income with AI in 2026: 7 Autonomous Systems Making Money While You SleepDev.to AIRamu Gopal: The Engineer Bridging CAD Automation and AI SystemsMedium AIlantea AI用的什么AI模型Dev.to AI汽车智能驾驶行业的公司做校招可以怎么选校招服务商Dev.to AIWhy AI’s Next Leap Won’t Come From Bigger Models But From Better ArchitecturesMedium AIThis AI Agent Backend Took Me Days — You Can Use It in MinutesMedium AIA 95% Facial Match Falls Apart If the Face Itself Is FakeDev.to AII Mapped the OWASP Top 10 for AI Agents Against My Scanner — Here's What's MissingDev.to AIClaude Code Source Leak: What Anthropic’s Hidden Features Actually RevealMedium AIHow to Build Real-World AI Agents with Qwen3.6-PlusMedium AIBlack Hat USAAI BusinessBlack Hat AsiaAI Businesshiggsfield brings art-directed quality to AI image generation at production scale - DesignboomGNews AI artWith an eye on China, Japan looks to kamikaze drones and low-cost missilesSCMP Tech (Asia AI)Passive Income with AI in 2026: 7 Autonomous Systems Making Money While You SleepDev.to AIRamu Gopal: The Engineer Bridging CAD Automation and AI SystemsMedium AIlantea AI用的什么AI模型Dev.to AI汽车智能驾驶行业的公司做校招可以怎么选校招服务商Dev.to AIWhy AI’s Next Leap Won’t Come From Bigger Models But From Better ArchitecturesMedium AIThis AI Agent Backend Took Me Days — You Can Use It in MinutesMedium AIA 95% Facial Match Falls Apart If the Face Itself Is FakeDev.to AII Mapped the OWASP Top 10 for AI Agents Against My Scanner — Here's What's MissingDev.to AIClaude Code Source Leak: What Anthropic’s Hidden Features Actually RevealMedium AIHow to Build Real-World AI Agents with Qwen3.6-PlusMedium AI
AI NEWS HUBbyEIGENVECTOREigenvector

Toward Reliable Evaluation of LLM-Based Financial Multi-Agent Systems: Taxonomy, Coordination Primacy, and Cost Awareness

arXivMarch 31, 202610 min read0 views
Source Quiz

arXiv:2603.27539v1 Announce Type: cross Abstract: Multi-agent systems based on large language models (LLMs) for financial trading have grown rapidly since 2023, yet the field lacks a shared framework for understanding what drives performance or for evaluating claims credibly. This survey makes three contributions. First, we introduce a four-dimensional taxonomy, covering architecture pattern, coordination mechanism, memory architecture, and tool integration; applied to 12 multi-agent systems and two single-agent baselines. Second, we formulate the Coordination Primacy Hypothesis (CPH): inter-a — Phat Nguyen, Thang Pham

View PDF HTML (experimental)

Abstract:Multi-agent systems based on large language models (LLMs) for financial trading have grown rapidly since 2023, yet the field lacks a shared framework for understanding what drives performance or for evaluating claims credibly. This survey makes three contributions. First, we introduce a four-dimensional taxonomy, covering architecture pattern, coordination mechanism, memory architecture, and tool integration; applied to 12 multi-agent systems and two single-agent baselines. Second, we formulate the Coordination Primacy Hypothesis (CPH): inter-agent coordination protocol design is a primary driver of trading decision quality, often exerting greater influence than model scaling. CPH is presented as a falsifiable research hypothesis supported by tiered structural evidence rather than as an empirically validated conclusion; its definitive validation requires evaluation infrastructure that does not yet exist in the field. Third, we document five pervasive evaluation failures (look-ahead bias, survivorship bias, backtesting overfitting, transaction cost neglect, and regime-shift blindness) and show that these can reverse the sign of reported returns. Building on the CPH and the evaluation critique, we introduce the Coordination Breakeven Spread (CBS), a metric for determining whether multi-agent coordination adds genuine value net of transaction costs, and propose minimum evaluation standards as prerequisites for validating the CPH.

Comments: Accepted at the DMO-FinTech Workshop, PAKDD 2026, Hong Kong

Subjects:

Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)

Cite as: arXiv:2603.27539 [cs.MA]

(or arXiv:2603.27539v1 [cs.MA] for this version)

https://doi.org/10.48550/arXiv.2603.27539

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Thang M. Pham [view email] [v1] Sun, 29 Mar 2026 06:35:07 UTC (65 KB)

Was this article helpful?

Sign in to highlight and annotate this article

AI
Ask AI about this article
Powered by Eigenvector · full article context loaded
Ready

Conversation starters

Ask anything about this article…

Daily AI Digest

Get the top 5 AI stories delivered to your inbox every morning.

Knowledge Map

Knowledge Map
TopicsEntitiesSource
Toward Reli…researchpaperarxivaiartificial-…arXiv

Connected Articles — Knowledge Graph

This article is connected to other articles through shared AI topics and tags.

Knowledge Graph100 articles · 159 connections
Scroll to zoom · drag to pan · click to open

Discussion

Sign in to join the discussion

No comments yet — be the first to share your thoughts!

More in Research Papers