GAS: A Lightweight Framework for Filtered Search over Wide-table Vectors
Ziyuan He, Yuxiang Wang, Yu Sun, Zijie Ma, Hui Li, Qian Tao, Yu Li, Yongxin Tong
Abstract
Wide-table vectors, where each embedding is linked with numerous structured attributes, are prevalent in applications such as autonomous driving and multimodal data processing for large-model training. Efficiently retrieving semantically similar vectors under attribute filters is crucial for these tasks, a problem addressed by Filtered Approximate Nearest Neighbor Search (FANNS). Recent approaches follow two paradigms: (1) building per-attribute dedicated indexes that integrate attribute information, which incurs prohibitive build time and storage in wide-table settings; or (2) building an attribute-agnostic general index and applying predicates at query time, which often degrades search efficiency. Consequently, neither paradigm adequately supports wide-table scenarios. We aim to achieve good query performance with low upfront cost by incorporating information from many attributes into a single graph index, avoiding prohibitive overhead. Our key observation is that graph-traversal information from past queries can be reused to optimize future queries with the same filter attribute. Based on this insight, we devise Graph with Adaptive Shortcuts (GAS), a framework that leverages historical query logs to build lightweight auxiliary structures, enhancing search efficiency over a single base graph with minimal overhead. Extensive experiments on real-world datasets show that GAS consistently outperforms existing general indexes in wide-table scenarios, achieving up to 42.1× speedup on datasets with thousands of structured attributes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2f119be0-e8eb-4ab8-9a1d-c55b91d54e9eBuilds on23
- A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor SearchMengzhao Wang, Xiaoliang Xu, Qiang Yue, Yuxiang WangVLDB 2021 · 354 citations
- SPANN: Highly-efficient Billion-scale Approximate Nearest Neighborhood SearchQi Chen, Bing Zhao, Haidong Wang, Mingqin Li et al.NeurIPS 2021 · 219 citations
- Learning Multi-Dimensional IndexesVikram Nathan, Jialin Ding, Mohammad Alizadeh, Tim KraskaSIGMOD 2020 · 180 citations
- Filtered-DiskANN: Graph Algorithms for Approximate Nearest Neighbor Search with FiltersSiddharth Gollapudi, Neel Karia, Varun Sivashankar, Ravishankar Krishnaswamy et al.WWW 2023 · 102 citations
- Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional SpacesXi Zhao, Yao Tian, Kai Huang, Bolong Zheng et al.VLDB 2023 · 88 citations
Related papers
- Navigating Labels and Vectors: A Unified Approach to Filtered Approximate Nearest Neighbor SearchYuzheng Cai, Jiayang Shi, Yizhuo Chen, Weiguo ZhengSIGMOD 2025 · 26 citations
- Harmonizing Efficiency and Accuracy in Filtered Vector SearchZixiang Zhou, Xuhao ChenVLDB 2026
- SeRF: Segment Graph for Range-Filtering Approximate Nearest Neighbor SearchChaoji Zuo, Miao Qiao, Wenchao Zhou, Feifei Li et al.SIGMOD 2024 · 41 citations
- WoW: A Window-to-Window Incremental Index for Range-Filtering Approximate Nearest Neighbor SearchZiqi Wang, Jingzhe Zhang, Wei HuSIGMOD 2026 · 3 citations
- Tag-Filtered Approximate Nearest Neighbor SearchJiarui Luo, Miao Qiao, Chaoji Zuo, Dong DengICDE 2025 · 3 citations
