On the Use of Bagging for Local Intrinsic Dimensionality Estimation
The theory of Local Intrinsic Dimensionality (LID) has become a valuable tool for characterizing local complexity within and across data manifolds, supporting a range of data mining and machine learning tasks. Accurate LID estimation requires samples drawn from small neighborhoods around each query to avoid biases from nonlocal effects and potential manifold mixing, yet limited data within such neighborhoods tends to cause high estimation variance. As a variance reduction strategy, we propose an ensemble approach that uses subbagging to preserve the local distribution of nearest neighbor (NN) — Kristóf Péter, Ricardo J. G. B. Campello, James Bailey
View PDF HTML (experimental)
Abstract:The theory of Local Intrinsic Dimensionality (LID) has become a valuable tool for characterizing local complexity within and across data manifolds, supporting a range of data mining and machine learning tasks. Accurate LID estimation requires samples drawn from small neighborhoods around each query to avoid biases from nonlocal effects and potential manifold mixing, yet limited data within such neighborhoods tends to cause high estimation variance. As a variance reduction strategy, we propose an ensemble approach that uses subbagging to preserve the local distribution of nearest neighbor (NN) distances. The main challenge is that the uniform reduction in total sample size within each subsample increases the proximity threshold for finding a fixed number k of NNs around the query. As a result, in the specific context of LID estimation, the sampling rate has an additional, complex interplay with the neighborhood size, where both combined determine the sample size as well as the locality and resolution considered for estimation. We analyze both theoretically and experimentally how the choice of the sampling rate and the k-NN size used for LID estimation, alongside the ensemble size, affects performance, enabling informed prior selection of these hyper-parameters depending on application-based preferences. Our results indicate that within broad and well-characterized regions of the hyper-parameters space, using a bagged estimator will most often significantly reduce variance as well as the mean squared error when compared to the corresponding non-bagged baseline, with controllable impact on bias. We additionally propose and evaluate different ways of combining bagging with neighborhood smoothing for substantial further improvements on LID estimation performance.
Comments: Main document: 10 pages, 5 figures; Appendix: 38 pages, 27 figures
Subjects:
Machine Learning (cs.LG); Machine Learning (stat.ML)
ACM classes: H.2.8; G.3; I.5.1
Cite as: arXiv:2603.24384 [cs.LG]
(or arXiv:2603.24384v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2603.24384
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Kristóf Péter [view email] [v1] Wed, 25 Mar 2026 15:03:25 UTC (5,813 KB)
Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
researchpaperarxiv
Major 4-day workweek study suggests that when we work 5 days we spend one doing basically nothing
Research says workers can get as much done in a 33-hour week as in 38 hours. Essentially, those of us on a five-day week are filling up our days with time-wasting activities.
UKRI Deems Turing Institute Not Yet Satisfactory
UK Research and Innovation (UKRI) found that the Alan Turing Institute s strategic alignment and value for money are not yet satisfactory in a review of the AI research body s performance. The Turing Institute has dealt with a tumultuous year, with its head stepping down amid pushback from staff complaining about a toxic work environment. The [ ] The post UKRI Deems Turing Institute Not Yet Satisfactory appeared first on DIGIT .
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!