E2E: Efficient Filtered AKNN Search via Adaptive Termination
Wenxuan Xia, Mingyu Yang, Wentao Li, Wei Wang
Abstract
Approximate k-Nearest Neighbor (AKNN) search is widely used in vector databases. When vectors carry additional attributes (e.g., labels or numerical values), filtered AKNN search retrieves the nearest vectors to a query vector under attribute constraints. Most existing methods use a fixed termination condition, searching the entire index while respecting attribute filters. However, this leads to substantial redundant computations, since different queries require different amounts of search effort, and thus misses early termination opportunities for easy queries. This paper proposes a lightweight model to estimate the search cost of filtered AKNN queries and enable adaptive termination : For easy queries, the search stops early to reduce latency, while for hard queries, it continues longer to preserve accuracy. The key challenge is accurate cost prediction under attribute filters. To address this, we show that information collected during an early probing phase (e.g., attribute distributions and intermediate distance statistics) can effectively predict the overall search cost. Experiments on six real-world datasets demonstrate 1.1×--3.7× speedup over state-of-the-art baselines at 95% recall, while maintaining search accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5773872f-deb5-45b2-9f0e-e5f24b3b051eBuilds on33
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Accelerating Large-Scale Inference with Anisotropic Vector QuantizationRuiqi Guo, Philip Sun, Erik Lindgren, Quan Geng et al.ICML 2020 · 539 citations
- Improving Approximate Nearest Neighbor Search through Learned Adaptive Early TerminationConglong Li, Minjia Zhang, David G. Andersen, Yuxiong HeSIGMOD 2020 · 86 citations
- VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed MonotonicityQianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui et al.OSDI 2023 · 75 citations
- Efficient Approximate Nearest Neighbor Search in Multi-dimensional DatabasesYun Peng, Byron Choi, Tsz Nam Chan, Jianye Yang et al.SIGMOD 2023 · 74 citations
Related papers
- Recall-Aware Early Termination in Approximate Nearest Neighbor SearchShuang Hao, Xinxin Li, Wei ZhangKDD 2026
- Elastic Index Selection for Label-Hybrid AKNN SearchMingyu Yang, Wenxuan Xia, Wentao Li, Raymond Chi-Wing Wong et al.VLDB 2026
- ANSMET: Approximate Nearest Neighbor Search with Near-Memory Processing and Hybrid Early TerminationYiwei Li, Yuxin Jin, Boyu Tian, Huanchen Zhang et al.ISCA 2025 · 10 citations
- Navigating Labels and Vectors: A Unified Approach to Filtered Approximate Nearest Neighbor SearchYuzheng Cai, Jiayang Shi, Yizhuo Chen, Weiguo ZhengSIGMOD 2025 · 26 citations
- Filtered-DiskANN: Graph Algorithms for Approximate Nearest Neighbor Search with FiltersSiddharth Gollapudi, Neel Karia, Varun Sivashankar, Ravishankar Krishnaswamy et al.WWW 2023 · 102 citations
