Curator: Efficient Vector Search with Low-Selectivity Filters
Yicheng Jin, Yongji Wu, Wenjun Hu, Bruce M. Maggs, Jun Yang, Xiao Zhang, Danyang Zhuo
摘要
Embedding-based dense retrieval has become the cornerstone of many critical applications, where approximate nearest neighbor search (ANNS) queries are often combined with filters on labels such as dates and price ranges. Graph-based indexes achieve state-of-the-art performance on unfiltered ANNS but encounter connectivity breakdown on low-selectivity filtered queries, where qualifying vectors become sparse and the graph structure among them fragments. Recent research proposes specialized graph indexes that address this issue by expanding graph degree, which incurs prohibitively high construction costs. Given these inherent limitations of graph-based methods, we argue for a dual-index architecture and present Curator, a partition-based index that complements existing graph-based approaches for low-selectivity filtered ANNS. Curator builds specialized indexes for different labels within a shared clustering tree, where each index adapts to the distribution of its qualifying vectors to ensure efficient search while sharing structure to minimize memory overhead. The system also supports incremental updates and handles arbitrary complex predicates beyond single-label filters by efficiently constructing temporary indexes on the fly. Our evaluation demonstrates that integrating Curator with state-of-the-art graph indexes reduces low-selectivity query latency by up to 20.9x compared to pre-filtering fallback, while increasing construction time and memory footprint by only 5.5% and 4.3%, respectively.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 被引用 19,162 次
- SPANN: Highly-efficient Billion-scale Approximate Nearest Neighborhood SearchQi Chen, Bing Zhao, Haidong Wang, Mingqin Li 等NeurIPS 2021 · 被引用 219 次
- VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed MonotonicityQianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui 等OSDI 2023 · 被引用 75 次
- ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured DataLiana Patel, Peter Kraft, Carlos Guestrin, Matei ZahariaSIGMOD 2024 · 被引用 58 次
相关 Paper
- Filtered-DiskANN: Graph Algorithms for Approximate Nearest Neighbor Search with FiltersSiddharth Gollapudi, Neel Karia, Varun Sivashankar, Ravishankar Krishnaswamy 等WWW 2023 · 被引用 102 次
- DIGRA: A Dynamic Graph Indexing for Approximate Nearest Neighbor Search with Range FilterMengxu Jiang, Zhi Yang, Fangyuan Zhang, Guanhao Hou 等SIGMOD 2025 · 被引用 12 次
- Tag-Filtered Approximate Nearest Neighbor SearchJiarui Luo, Miao Qiao, Chaoji Zuo, Dong DengICDE 2025 · 被引用 3 次
- SeRF: Segment Graph for Range-Filtering Approximate Nearest Neighbor SearchChaoji Zuo, Miao Qiao, Wenchao Zhou, Feifei Li 等SIGMOD 2024 · 被引用 41 次
- Navigating Labels and Vectors: A Unified Approach to Filtered Approximate Nearest Neighbor SearchYuzheng Cai, Jiayang Shi, Yizhuo Chen, Weiguo ZhengSIGMOD 2025 · 被引用 26 次
