ConANN: Conformal Approximate Nearest Neighbor Search
Sonia Horchidan, Fabian Zeiher, Henrik Boström, Paris Carbone
Abstract
Approximate Nearest Neighbor (ANN) search is widely used in applications such as recommendation systems, search engines, and natural language processing. Indexing techniques like the Inverted File (IVF) offer efficiency at the cost of accuracy, yet lack formal mechanisms to quantify or control approximation error. Existing approaches that attempt to provide such guarantees typically rely on restrictive assumptions about underlying data distributions, which limits their generalizability. We introduce ConANN, the first framework to provide formal, distribution-free error guarantees for IVF-based ANN search by leveraging recent advances in Conformal Risk Control. Empirical evaluation across five standard benchmarks demonstrates that ConANN: (1) tightly controls approximation error, achieving a worst-case False Negative Rate deviation within 0.03 percentage points of the target; (2) provides formal guarantees without requiring expansion of the search space, and in some cases even reduces the number of probed clusters; (3) dynamically adapts the cluster probes required per query; and (4) incurs negligible overheads when compared to existing state-of-the-art baselines. ConANN is integrated into the FAISS vector search library, facilitating adoption in real-world ANN systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on10
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Adaptive Conformal Inference Under Distribution ShiftIsaac Gibbs, Emmanuel J. CandèsNeurIPS 2021 · 665 citations
- Conformal Risk ControlAnastasios Nikolas Angelopoulos, Stephen Bates, Adam Fisch, Lihua Lei et al.ICLR 2024 · 242 citations
- Improving Approximate Nearest Neighbor Search through Learned Adaptive Early TerminationConglong Li, Minjia Zhang, David G. Andersen, Yuxiong HeSIGMOD 2020 · 86 citations
- RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor SearchJianyang Gao, Cheng LongSIGMOD 2024 · 83 citations
Related papers
- Automating Nearest Neighbor Search Configuration with Constrained OptimizationPhilip Sun, Ruiqi Guo, Sanjiv KumarICLR 2023 · 1 citation
- Towards Accurate Distance Estimation for Distribution-Aware c-ANN SearchLiwei Deng, Penghao Chen, Ximu Zeng, Yuchen Fang et al.ICDE 2025 · 1 citation
- Leanor: A Learning-Based Accelerator for Efficient Approximate Nearest Neighbor Search via Reduced Memory AccessYi Wang, Huan Liu, Jianan Yuan, Jiaxian Chen et al.DAC 2024 · 4 citations
- ANNA: Specialized Architecture for Approximate Nearest Neighbor SearchYejin Lee, Hyunji Choi, Sunhong Min, Hyunseung Lee et al.HPCA 2022 · 37 citations
- GPU-Native Approximate Nearest Neighbor Search with IVF-RaBitQ: Fast Index Build and SearchJifan Shi, Jianyang Gao, James Xia, Tamas B. Fehér et al.VLDB 2026 · 7 citations
