Maximum Inner Product is Query-Scaled Nearest Neighbor
Tingyang Chen, Cong Fu, Kun Wang, Xiangyu Ke, Yunjun Gao, Wenchao Zhou, Yabo Ni, Anxiang Zeng
Abstract
Maximum Inner Product Search (MIPS) for high-dimensional vectors is pivotal across databases, information retrieval, and artificial intelligence. Existing methods either reduce MIPS to Nearest Neighbor Search (NNS) while suffering from harmful vector space transformations, or attempt to tackle MIPS directly but struggle to mitigate redundant computations due to the absence of the triangle inequality. This paper presents a novel theoretical framework that equates MIPS with NNS without requiring space transformation, thereby allowing us to leverage advanced graph-based indices for NNS and efficient edge pruning strategies, significantly reducing unnecessary computations. Despite a strong baseline set by our theoretical analysis, we identify and address two persistent challenges to further refine our method: the introduction of the P roximity Graph with S pherical P athway (PSP), designed to mitigate the issue of MIPS solutions clustering around large-norm vectors, and the implementation of A daptive E arly T ermination (AET), which efficiently curtails the excessive exploration once an accuracy bottleneck is reached. Extensive experiments reveal that our method is superior to existing state-of-the-art techniques in search efficiency, scalability, and practical applicability. Compared with state-of-the-art graph-based methods, it achieves an average 35% speed-up in query processing and a 3× reduction in index size. Notably, our approach has been validated and deployed in the search engines of Shopee, a well-known online shopping platform. Our code and an industrial-scale dataset for offline evaluation will also be released to address the absence of e-commerce data in public benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5674fd39-38ee-4f5f-bb3d-1924cdc3d137Cited by top-tier papers4
- Reveal Hidden Pitfalls and Navigate Next Generation of Vector Similarity Search from Task-Centric Views: [Experiments & Analysis]Tingyang Chen, Cong Fu, Jiahua Wu, Haotian Wu et al.SIGMOD 2026 · 5 citations
- Empowering Graph-based Approximate Nearest Neighbor Search with Adaptive Awareness CapabilitiesJiancheng Ruan, Tingyang Chen, Renchi Yang, Xiangyu Ke et al.KDD 2025 · 2 citations
- Stitching Inner Product and Euclidean Metrics for Topology-aware Maximum Inner Product SearchTingyang Chen, Cong Fu, Xiangyu Ke, Yunjun Gao et al.SIGIR 2025 · 1 citation
- FGIM: a Fast Graph-based Indexes Merging Framework for Approximate Nearest Neighbor SearchZekai Wu, Jiabao Jin, Peng Cheng, Xiaoyao Zhong et al.SIGMOD 2026
Builds on18
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Accelerating Large-Scale Inference with Anisotropic Vector QuantizationRuiqi Guo, Philip Sun, Erik Lindgren, Quan Geng et al.ICML 2020 · 539 citations
- A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor SearchMengzhao Wang, Xiaoliang Xu, Qiang Yue, Yuxiang WangVLDB 2021 · 354 citations
- Improving Approximate Nearest Neighbor Search through Learned Adaptive Early TerminationConglong Li, Minjia Zhang, David G. Andersen, Yuxiong HeSIGMOD 2020 · 86 citations
Related papers
- Norm Adjusted Proximity Graph for Fast Inner Product RetrievalShulong Tan, Zhaozhuo Xu, Weijie Zhao, Hongliang Fei et al.KDD 2021 · 20 citations
- Efficient Approximate Maximum Inner Product Search Over Sparse VectorsXi Zhao, Zhonghan Chen, Kai Huang, Ruiyuan Zhang et al.ICDE 2024 · 10 citations
- SINDI: An Efficient Index for Sparse Vector Approximate Maximum Inner Product SearchRuoxuan Li, Xiaoyao Zhong, Jiabao Jin, Peng Cheng et al.ICDE 2026 · 3 citations
- Enhancing Graph-based Approximate Maximum Inner Product Search via Norm-Adaptive PartitioningXi Zhao, Zhoujin Tian, Kai Huang, Yao Tian et al.SIGMOD 2026
- FARGO: Fast Maximum Inner Product Search via Global Multi-ProbingXi Zhao, Bolong Zheng, Xiaomeng Yi, Xiaofan Luan et al.VLDB 2023 · 22 citations
