LLM as an Algorithmist: Enhancing Anomaly Detectors via Programmatic Synthesis

View PDF HTML (experimental)

Abstract:Existing anomaly detection (AD) methods for tabular data usually rely on some assumptions about anomaly patterns, leading to inconsistent performance in real-world scenarios. While Large Language Models (LLMs) show remarkable reasoning capabilities, their direct application to tabular AD is impeded by fundamental challenges, including difficulties in processing heterogeneous data and significant privacy risks. To address these limitations, we propose LLM-DAS, a novel framework that repositions the LLM from a data processor'' to an algorithmist''. Instead of being exposed to raw data, our framework leverages the LLM's ability to reason about algorithms. It analyzes a high-level description of a given detector to understand its intrinsic weaknesses and then generates detector-specific, data-agnostic Python code to synthesize ``hard-to-detect'' anomalies that exploit these vulnerabilities. This generated synthesis program, which is reusable across diverse datasets, is then instantiated to augment training data, systematically enhancing the detector's robustness by transforming the problem into a more discriminative two-class classification task. Extensive experiments on 36 TAD benchmarks show that LLM-DAS consistently boosts the performance of mainstream detectors. By bridging LLM reasoning with classic AD algorithms via programmatic synthesis, LLM-DAS offers a scalable, effective, and privacy-preserving approach to patching the logical blind spots of existing detectors.

Comments: Accepted by the Fourteenth International Conference on Learning Representations (ICLR 2026)

Subjects:

Machine Learning (cs.LG)

Cite as: arXiv:2510.03904 [cs.LG]

(or arXiv:2510.03904v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2510.03904

arXiv-issued DOI via DataCite

Submission history

From: Hangting Ye [view email] [v1] Sat, 4 Oct 2025 19:00:51 UTC (732 KB) [v2] Mon, 30 Mar 2026 05:47:30 UTC (1,319 KB)