SciEGQA: A Dataset for Scientific Evidence-Grounded Question Answering and Reasoning

View PDF HTML (experimental)

Abstract:Scientific documents contain complex multimodal structures, which makes evidence localization and scientific reasoning in Document Visual Question Answering particularly challenging. However, most existing benchmarks evaluate models only at the page level without explicitly annotating the evidence regions that support the answer, which limits both interpretability and the reliability of evaluation. To address this limitation, we introduce SciEGQA, a scientific document question answering and reasoning dataset with semantic evidence grounding, where supporting evidence is represented as semantically coherent document regions annotated with bounding boxes. SciEGQA consists of two components: a human-annotated fine-grained benchmark containing 1,623 high-quality question--answer pairs, and a large-scale automatically constructed training set with over 30K QA pairs generated through an automated data construction pipeline. Extensive experiments on a wide range of Vision-Language Models (VLMs) show that existing models still struggle with evidence localization and evidence-based question answering in scientific documents. Training on the proposed dataset significantly improves the scientific reasoning capabilities of VLMs. The project page is available at this https URL.

Comments: 8 pages, 4 figures, 3 tables

Subjects:

Databases (cs.DB); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2511.15090 [cs.DB]

(or arXiv:2511.15090v2 [cs.DB] for this version)

https://doi.org/10.48550/arXiv.2511.15090

arXiv-issued DOI via DataCite

Submission history

From: Wenhan Yu [view email] [v1] Wed, 19 Nov 2025 04:03:54 UTC (2,212 KB) [v2] Mon, 30 Mar 2026 06:53:39 UTC (22,175 KB)