Elastic Index Selection for Label-Hybrid AKNN Search
Mingyu Yang, Wenxuan Xia, Wentao Li, Raymond Chi-Wing Wong, Wei Wang
Abstract
Real-world vector embeddings often carry additional label attributes, such as keywords and tags. In this context,
label-hybrid approximate k -nearest neighbor (AKNN)
search retrieves the top- k approximate nearest vectors to a query, subject to the constraint that their labels fully contain the query-label set. A naive solution builds a separate index for every query-label set, but the exponential growth of such sets makes this approach storage-prohibitive. To overcome this, we propose selectively indexing only a subset of query-label sets while still ensuring efficient processing for all queries. This is made possible by a key insight into label containment: an index built for a label set L can also serve any query whose label set L' is a superset of L , with query cost bounded by the elastic factor—the ratio between the number of vectors matching L and those matching L' . We formalize the index-selection task as a constrained optimization problem that chooses which label sets to index to satisfy space and query efficiency constraints. We prove the problem is NP-complete and propose efficient greedy algorithms for its efficiency- and space-constrained variants. Extensive experiments on real-world datasets show that our method achieves 10X-800X speedups over state-of-the-art techniques. Moreover, our approach is index-agnostic and can be seamlessly integrated into existing vector database systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 36f47933-78b3-4d2e-a7c2-e87135b601ddCited by top-tier papers1
Ask how each one uses itBuilds on22
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor SearchMengzhao Wang, Xiaoliang Xu, Qiang Yue, Yuxiang WangVLDB 2021 · 354 citations
- RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor SearchJianyang Gao, Cheng LongSIGMOD 2024 · 83 citations
- VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed MonotonicityQianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui et al.OSDI 2023 · 75 citations
- Efficient Approximate Nearest Neighbor Search in Multi-dimensional DatabasesYun Peng, Byron Choi, Tsz Nam Chan, Jianye Yang et al.SIGMOD 2023 · 74 citations
Related papers
- Navigating Labels and Vectors: A Unified Approach to Filtered Approximate Nearest Neighbor SearchYuzheng Cai, Jiayang Shi, Yizhuo Chen, Weiguo ZhengSIGMOD 2025 · 26 citations
- Filtered-DiskANN: Graph Algorithms for Approximate Nearest Neighbor Search with FiltersSiddharth Gollapudi, Neel Karia, Varun Sivashankar, Ravishankar Krishnaswamy et al.WWW 2023 · 102 citations
- FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion DistancesJunjie Song, Yu Liu, Guoyu Hu, Zhongle Xie et al.SIGMOD 2026 · 1 citation
- ARKGraph: All-Range Approximate K-Nearest-Neighbor GraphChaoji Zuo, Dong DengVLDB 2023 · 18 citations
- LAN: Learning-based Approximate k-Nearest Neighbor Search in Graph DatabasesYun Peng, Byron Choi, Tsz Nam Chan, Jianliang XuICDE 2022 · 7 citations
