RenoBench: A Citation Parsing Benchmark

View PDF HTML (experimental)

Abstract:Accurate parsing of citations is necessary for machine-readable scholarly infrastructure. But, despite sustained interest in this problem, existing evaluation techniques are often not generalizable, based on synthetic data, or not publicly available. We introduce RenoBench, a public domain benchmark for citation parsing, sourced from PDFs released on four publishing ecosystems: SciELO, Redalyc, the Public Knowledge Project, and Open Research Europe. Starting from 161,000 annotated citations, we apply automated validation and feature-based sampling to produce a dataset of 10,000 citations spanning multiple languages, publication types, and platforms. We then evaluate a variety of citation parsing systems and report field-level precision and recall. Our results show strong performance from language models, particularly when fine-tuned. RenoBench enables reproducible, standardized evaluation of citation parsing systems, and provides a foundation for advancing automated citation parsing and metascientific research.

Subjects:

Digital Libraries (cs.DL); Computation and Language (cs.CL)

ACM classes: H.3.1; I.7.4

Cite as: arXiv:2603.25640 [cs.DL]

(or arXiv:2603.25640v1 [cs.DL] for this version)

https://doi.org/10.48550/arXiv.2603.25640

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Parth Sarin [view email] [v1] Thu, 26 Mar 2026 16:52:31 UTC (300 KB)