Zero-shot Vision-Language Reranking for Cross-View Geolocalization

View PDF HTML (experimental)

Abstract:Cross-view geolocalization (CVGL) systems, while effective at retrieving a list of relevant candidates (high Recall@k), often fail to identify the single best match (low Top-1 accuracy). This work investigates the use of zero-shot Vision-Language Models (VLMs) as rerankers to address this gap. We propose a two-stage framework: state-of-the-art (SOTA) retrieval followed by VLM reranking. We systematically compare two strategies: (1) Pointwise (scoring candidates individually) and (2) Pairwise (comparing candidates relatively). Experiments on the VIGOR dataset show a clear divergence: all pointwise methods cause a catastrophic drop in performance or no change at all. In contrast, a pairwise comparison strategy using LLaVA improves Top-1 accuracy over the strong retrieval baseline. Our analysis concludes that, these VLMs are poorly calibrated for absolute relevance scoring but are effective at fine-grained relative visual judgment, making pairwise reranking a promising direction for enhancing CVGL precision.

Comments: 7 pages, 4 figures. Accepted to XXV ISPRS Congress

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

Cite as: arXiv:2603.27251 [cs.CV]

(or arXiv:2603.27251v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.27251

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Yunus Talha Erzurumlu [view email] [v1] Sat, 28 Mar 2026 11:57:41 UTC (16,658 KB)