ConANN: Conformal Approximate Nearest Neighbor Search
Sonia Horchidan, Fabian Zeiher, Henrik Boström, Paris Carbone
摘要
Approximate Nearest Neighbor (ANN) search is widely used in applications such as recommendation systems, search engines, and natural language processing. Indexing techniques like the Inverted File (IVF) offer efficiency at the cost of accuracy, yet lack formal mechanisms to quantify or control approximation error. Existing approaches that attempt to provide such guarantees typically rely on restrictive assumptions about underlying data distributions, which limits their generalizability. We introduce ConANN, the first framework to provide formal, distribution-free error guarantees for IVF-based ANN search by leveraging recent advances in Conformal Risk Control. Empirical evaluation across five standard benchmarks demonstrates that ConANN: (1) tightly controls approximation error, achieving a worst-case False Negative Rate deviation within 0.03 percentage points of the target; (2) provides formal guarantees without requiring expansion of the search space, and in some cases even reduces the number of probed clusters; (3) dynamically adapts the cluster probes required per query; and (4) incurs negligible overheads when compared to existing state-of-the-art baselines. ConANN is integrated into the FAISS vector search library, facilitating adoption in real-world ANN systems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper10
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 被引用 19,162 次
- Adaptive Conformal Inference Under Distribution ShiftIsaac Gibbs, Emmanuel J. CandèsNeurIPS 2021 · 被引用 665 次
- Conformal Risk ControlAnastasios Nikolas Angelopoulos, Stephen Bates, Adam Fisch, Lihua Lei 等ICLR 2024 · 被引用 242 次
- Improving Approximate Nearest Neighbor Search through Learned Adaptive Early TerminationConglong Li, Minjia Zhang, David G. Andersen, Yuxiong HeSIGMOD 2020 · 被引用 86 次
- RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor SearchJianyang Gao, Cheng LongSIGMOD 2024 · 被引用 83 次
相关 Paper
- Automating Nearest Neighbor Search Configuration with Constrained OptimizationPhilip Sun, Ruiqi Guo, Sanjiv KumarICLR 2023 · 被引用 1 次
- Towards Accurate Distance Estimation for Distribution-Aware c-ANN SearchLiwei Deng, Penghao Chen, Ximu Zeng, Yuchen Fang 等ICDE 2025 · 被引用 1 次
- Leanor: A Learning-Based Accelerator for Efficient Approximate Nearest Neighbor Search via Reduced Memory AccessYi Wang, Huan Liu, Jianan Yuan, Jiaxian Chen 等DAC 2024 · 被引用 4 次
- ANNA: Specialized Architecture for Approximate Nearest Neighbor SearchYejin Lee, Hyunji Choi, Sunhong Min, Hyunseung Lee 等HPCA 2022 · 被引用 37 次
- GPU-Native Approximate Nearest Neighbor Search with IVF-RaBitQ: Fast Index Build and SearchJifan Shi, Jianyang Gao, James Xia, Tamas B. Fehér 等VLDB 2026 · 被引用 7 次
