Maximum Inner Product is Query-Scaled Nearest Neighbor
Tingyang Chen, Cong Fu, Kun Wang, Xiangyu Ke, Yunjun Gao, Wenchao Zhou, Yabo Ni, Anxiang Zeng
摘要
Maximum Inner Product Search (MIPS) for high-dimensional vectors is pivotal across databases, information retrieval, and artificial intelligence. Existing methods either reduce MIPS to Nearest Neighbor Search (NNS) while suffering from harmful vector space transformations, or attempt to tackle MIPS directly but struggle to mitigate redundant computations due to the absence of the triangle inequality. This paper presents a novel theoretical framework that equates MIPS with NNS without requiring space transformation, thereby allowing us to leverage advanced graph-based indices for NNS and efficient edge pruning strategies, significantly reducing unnecessary computations. Despite a strong baseline set by our theoretical analysis, we identify and address two persistent challenges to further refine our method: the introduction of the P roximity Graph with S pherical P athway (PSP), designed to mitigate the issue of MIPS solutions clustering around large-norm vectors, and the implementation of A daptive E arly T ermination (AET), which efficiently curtails the excessive exploration once an accuracy bottleneck is reached. Extensive experiments reveal that our method is superior to existing state-of-the-art techniques in search efficiency, scalability, and practical applicability. Compared with state-of-the-art graph-based methods, it achieves an average 35% speed-up in query processing and a 3× reduction in index size. Notably, our approach has been validated and deployed in the search engines of Shopee, a well-known online shopping platform. Our code and an industrial-scale dataset for offline evaluation will also be released to address the absence of e-commerce data in public benchmarks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Reveal Hidden Pitfalls and Navigate Next Generation of Vector Similarity Search from Task-Centric Views: [Experiments & Analysis]Tingyang Chen, Cong Fu, Jiahua Wu, Haotian Wu 等SIGMOD 2026 · 被引用 5 次
- Empowering Graph-based Approximate Nearest Neighbor Search with Adaptive Awareness CapabilitiesJiancheng Ruan, Tingyang Chen, Renchi Yang, Xiangyu Ke 等KDD 2025 · 被引用 2 次
- Stitching Inner Product and Euclidean Metrics for Topology-aware Maximum Inner Product SearchTingyang Chen, Cong Fu, Xiangyu Ke, Yunjun Gao 等SIGIR 2025 · 被引用 1 次
- FGIM: a Fast Graph-based Indexes Merging Framework for Approximate Nearest Neighbor SearchZekai Wu, Jiabao Jin, Peng Cheng, Xiaoyao Zhong 等SIGMOD 2026
它引用的顶会 Paper18
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 被引用 19,162 次
- Accelerating Large-Scale Inference with Anisotropic Vector QuantizationRuiqi Guo, Philip Sun, Erik Lindgren, Quan Geng 等ICML 2020 · 被引用 539 次
- A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor SearchMengzhao Wang, Xiaoliang Xu, Qiang Yue, Yuxiang WangVLDB 2021 · 被引用 354 次
- Improving Approximate Nearest Neighbor Search through Learned Adaptive Early TerminationConglong Li, Minjia Zhang, David G. Andersen, Yuxiong HeSIGMOD 2020 · 被引用 86 次
相关 Paper
- Norm Adjusted Proximity Graph for Fast Inner Product RetrievalShulong Tan, Zhaozhuo Xu, Weijie Zhao, Hongliang Fei 等KDD 2021 · 被引用 20 次
- Efficient Approximate Maximum Inner Product Search Over Sparse VectorsXi Zhao, Zhonghan Chen, Kai Huang, Ruiyuan Zhang 等ICDE 2024 · 被引用 10 次
- SINDI: An Efficient Index for Sparse Vector Approximate Maximum Inner Product SearchRuoxuan Li, Xiaoyao Zhong, Jiabao Jin, Peng Cheng 等ICDE 2026 · 被引用 3 次
- Enhancing Graph-based Approximate Maximum Inner Product Search via Norm-Adaptive PartitioningXi Zhao, Zhoujin Tian, Kai Huang, Yao Tian 等SIGMOD 2026
- FARGO: Fast Maximum Inner Product Search via Global Multi-ProbingXi Zhao, Bolong Zheng, Xiaomeng Yi, Xiaofan Luan 等VLDB 2023 · 被引用 22 次
