Live
Black Hat USAAI BusinessBlack Hat AsiaAI BusinessWeekend Project: I Built a Full MLOps Pipeline for a Credit Scoring Model (And You Can Too)Hackernoon AIShahed-killing interceptor drones may look simple, but building them to keep up with the threat isn't easyBusiness InsiderUber drivers: Your boss knows you're using Tesla's FSD on the jobBusiness InsiderPitchBook: US venture funding surges to record $267B as OpenAI, Anthropic and xAI dominate AI deals - SiliconANGLEGoogle News: OpenAISECURE: Stable Early Collision Understanding via Robust Embeddings in Autonomous DrivingarXivSven: Singular Value Descent as a Computationally Efficient Natural Gradient MethodarXivDetecting Complex Money Laundering Patterns with Incremental and Distributed Graph ModelingarXivDySCo: Dynamic Semantic Compression for Effective Long-term Time Series ForecastingarXivUQ-SHRED: uncertainty quantification of shallow recurrent decoder networks for sparse sensing via engressionarXivModel Merging via Data-Free Covariance EstimationarXivMassively Parallel Exact Inference for Hawkes ProcessesarXivEfficient and Principled Scientific Discovery through Bayesian Optimization: A TutorialarXivBlack Hat USAAI BusinessBlack Hat AsiaAI BusinessWeekend Project: I Built a Full MLOps Pipeline for a Credit Scoring Model (And You Can Too)Hackernoon AIShahed-killing interceptor drones may look simple, but building them to keep up with the threat isn't easyBusiness InsiderUber drivers: Your boss knows you're using Tesla's FSD on the jobBusiness InsiderPitchBook: US venture funding surges to record $267B as OpenAI, Anthropic and xAI dominate AI deals - SiliconANGLEGoogle News: OpenAISECURE: Stable Early Collision Understanding via Robust Embeddings in Autonomous DrivingarXivSven: Singular Value Descent as a Computationally Efficient Natural Gradient MethodarXivDetecting Complex Money Laundering Patterns with Incremental and Distributed Graph ModelingarXivDySCo: Dynamic Semantic Compression for Effective Long-term Time Series ForecastingarXivUQ-SHRED: uncertainty quantification of shallow recurrent decoder networks for sparse sensing via engressionarXivModel Merging via Data-Free Covariance EstimationarXivMassively Parallel Exact Inference for Hawkes ProcessesarXivEfficient and Principled Scientific Discovery through Bayesian Optimization: A TutorialarXiv
AI NEWS HUBbyEIGENVECTOREigenvector

AMIGO: Agentic Multi-Image Grounding Oracle Benchmark

arXivMarch 31, 202610 min read0 views
Source Quiz

arXiv:2603.28662v1 Announce Type: cross Abstract: Agentic vision-language models increasingly act through extended interactions, but most evaluations still focus on single-image, single-turn correctness. We introduce AMIGO (Agentic Multi-Image Grounding Oracle Benchmark), a long-horizon benchmark for hidden-target identification over galleries of visually similar images. In AMIGO, the oracle privately selects a target image, and the model must recover it by asking a sequence of attribute-focused Yes/No/Unsure questions under a strict protocol that penalizes invalid actions with Skip. This sett — Min Wang, Ata Mahjoubfar

View PDF HTML (experimental)

Abstract:Agentic vision-language models increasingly act through extended interactions, but most evaluations still focus on single-image, single-turn correctness. We introduce AMIGO (Agentic Multi-Image Grounding Oracle Benchmark), a long-horizon benchmark for hidden-target identification over galleries of visually similar images. In AMIGO, the oracle privately selects a target image, and the model must recover it by asking a sequence of attribute-focused Yes/No/Unsure questions under a strict protocol that penalizes invalid actions with Skip. This setting stresses (i) question selection under uncertainty, (ii) consistent constraint tracking across turns, and (iii) fine-grained discrimination as evidence accumulates. AMIGO also supports controlled oracle imperfections to probe robustness and verification behavior under inconsistent feedback. We instantiate AMIGO with Guess My Preferred Dress task and report metrics covering both outcomes and interaction quality, including identification success, evidence verification, efficiency, protocol compliance, noise tolerance, and trajectory-level diagnostics.

Subjects:

Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

Cite as: arXiv:2603.28662 [cs.LG]

(or arXiv:2603.28662v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2603.28662

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Min Wang [view email] [v1] Mon, 30 Mar 2026 16:48:51 UTC (29,613 KB)

Was this article helpful?

Sign in to highlight and annotate this article

AI
Ask AI about this article
Powered by Eigenvector · full article context loaded
Ready

Conversation starters

Ask anything about this article…

Daily AI Digest

Get the top 5 AI stories delivered to your inbox every morning.

Knowledge Map

Knowledge Map
TopicsEntitiesSource
AMIGO: Agen…researchpaperarxivaiartificial-…arXiv

Connected Articles — Knowledge Graph

This article is connected to other articles through shared AI topics and tags.

Knowledge Graph100 articles · 269 connections
Scroll to zoom · drag to pan · click to open

Discussion

Sign in to join the discussion

No comments yet — be the first to share your thoughts!

More in Research Papers