Who Wrote the Book? Detecting and Attributing LLM Ghostwriters

View PDF HTML (experimental)

Abstract:In this paper, we introduce GhostWriteBench, a dataset for LLM authorship attribution. It comprises long-form texts (50K+ words per book) generated by frontier LLMs, and is designed to test generalisation across multiple out-of-distribution (OOD) dimensions, including domain and unseen LLM author. We also propose TRACE -- a novel fingerprinting method that is interpretable and lightweight -- that works for both open- and closed-source models. TRACE creates the fingerprint by capturing token-level transition patterns (e.g., word rank) estimated by another lightweight language model. Experiments on GhostWriteBench demonstrate that TRACE achieves state-of-the-art performance, remains robust in OOD settings, and works well in limited training data scenarios.

Subjects:

Computation and Language (cs.CL)

Cite as: arXiv:2603.28054 [cs.CL]

(or arXiv:2603.28054v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2603.28054

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Qiongkai Xu [view email] [v1] Mon, 30 Mar 2026 05:41:12 UTC (16,215 KB)