SAH: Shifting-Aware Asymmetric Hashing for Reverse k Maximum Inner Product Search
Qiang Huang, Yanhao Wang, Anthony K. H. Tung
Abstract
This paper investigates a new yet challenging problem called Reverse k-Maximum Inner Product Search (RkMIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of RkMIPS aims to find a set of user vectors whose inner products with the query vector are one of the k largest among the query and item vectors. We propose the first subquadratic-time algorithm, i.e., Shifting-aware Asymmetric Hashing (SAH), to tackle the RkMIPS problem. To speed up the Maximum Inner Product Search (MIPS) on item vectors, we design a shifting-invariant asymmetric transformation and develop a novel sublinear-time Shifting-Aware Asymmetric Locality Sensitive Hashing (SA-ALSH) scheme. Furthermore, we devise a new blocking strategy based on the Cone-Tree to effectively prune user vectors (in a batch). We prove that SAH achieves a theoretical guarantee for solving the RMIPS problem. Experimental results on five real-world datasets show that SAH runs 4 8x faster than the state-of-the-art methods for RkMIPS while achieving F1-scores of over 90%. The code is available at https://github.com/HuangQiang/SAH.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d80de9a6-cb7f-4ac2-ac99-96c4ba6ec093Builds on4
- Understanding and Improving Proximity Graph Based Maximum Inner Product SearchJie Liu, Xiao Yan, Xinyan Dai, Zhirong Li et al.AAAI 2020 · 35 citations
- Norm-Explicit Quantization: Improving Vector Quantization for Maximum Inner Product SearchXinyan Dai, Xiao Yan, Kelvin Kai Wing Ng, Jiu Liu et al.AAAI 2020 · 34 citations
- Norm Adjusted Proximity Graph for Fast Inner Product RetrievalShulong Tan, Zhaozhuo Xu, Weijie Zhao, Hongliang Fei et al.KDD 2021 · 20 citations
- Simple Yet Efficient Algorithms for Maximum Inner Product Search via Extreme Order StatisticsNinh PhamKDD 2021 · 8 citations
Related papers
- FARGO: Fast Maximum Inner Product Search via Global Multi-ProbingXi Zhao, Bolong Zheng, Xiaomeng Yi, Xiaofan Luan et al.VLDB 2023 · 22 citations
- Reconsidering Tree based Methods for k-Maximum Inner-Product Search: The LRUS-CoverTreeHengzhao Ma, Jianzhong Li, Yong ZhangICDE 2024 · 3 citations
- ProMIPS: Efficient High-Dimensional c-Approximate Maximum Inner Product Search with a Lightweight IndexYang Song, Yu Gu, Rui Zhang, Ge YuICDE 2021 · 16 citations
- Efficient Approximate Maximum Inner Product Search Over Sparse VectorsXi Zhao, Zhonghan Chen, Kai Huang, Ruiyuan Zhang et al.ICDE 2024 · 10 citations
- Faster Maximum Inner Product Search in High DimensionsMo Tiwari, Ryan Kang, Jaeyong Lee, Donghyun Lee et al.ICML 2024 · 6 citations
