An Experimental Comparison of the Most Popular Approaches to Fake News Detection

View PDF HTML (experimental)

Abstract:In recent years, fake news detection has received increasing attention in public debate and scientific research. Despite advances in detection techniques, the production and spread of false information have become more sophisticated, driven by Large Language Models (LLMs) and the amplification power of social media. We present a critical assessment of 12 representative fake news detection approaches, spanning traditional machine learning, deep learning, transformers, and specialized cross-domain architectures. We evaluate these methods on 10 publicly available datasets differing in genre, source, topic, and labeling rationale. We address text-only English fake news detection as a binary classification task by harmonizing labels into "Real" and "Fake" to ensure a consistent evaluation protocol. We acknowledge that label semantics vary across datasets and that harmonization inevitably removes such semantic nuances. Each dataset is treated as a distinct domain. We conduct in-domain, multi-domain and cross-domain experiments to simulate real-world scenarios involving domain shift and out-of-distribution data. Fine-tuned models perform well in-domain but struggle to generalize. Cross-domain architectures can reduce this gap but are data-hungry, while LLMs offer a promising alternative through zero- and few-shot learning. Given inherent dataset confounds and possible pre-training exposure, results should be interpreted as robustness evaluations within this English, text-only protocol.

Subjects:

Computation and Language (cs.CL)

Cite as: arXiv:2603.25501 [cs.CL]

(or arXiv:2603.25501v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2603.25501

arXiv-issued DOI via DataCite (pending registration)

Journal reference: Dell'Oglio, P., Bondielli, A., Marcelloni, F., and Passaro, L. C. (2026). An experimental comparison of the most popular approaches to fake news detection. Information Sciences, Article 123407

Related DOI:

https://doi.org/10.1016/j.ins.2026.123407

DOI(s) linking to related resources

Submission history

From: Lucia Passaro [view email] [v1] Thu, 26 Mar 2026 14:39:35 UTC (4,732 KB)