MQH: Locality Sensitive Hashing on Multi-level Quantization Errors for Point-to-Hyperplane Distances
Kejing Lu, Yoshiharu Ishikawa, Chuan Xiao
摘要
Point-to-hyperplane nearest neighbor search (P2HNNS) is a fundamental problem which has many applications in data mining and machine learning. In this paper, we propose a provable Locality-Sensitive-Hashing (LSH) scheme based on multi-level quantization errors to solve this problem. In the indexing phase, for each data point, we compute the hash values of its residual vectors generated by a stepwise quantization process. In the query phase, for each processed point, we first determine its suitable level for hashing and then determine the size of hash bucket based on its quantization error in that level. We theoretically show that this treatment not only yields a probability guarantee on query results, but also makes the generated hash functions much more efficient to prune those false points. Experimental results on five real datasets show that the proposed approach generally runs 2X-10X faster than the state-of-the-art LSH-based approaches.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- Accelerating Large-Scale Inference with Anisotropic Vector QuantizationRuiqi Guo, Philip Sun, Erik Lindgren, Quan Geng 等ICML 2020 · 被引用 539 次
- HVS: Hierarchical Graph Structure Based on Voronoi Diagrams for Solving Approximate Nearest Neighbor SearchKejing Lu, Mineichi Kudo, Chuan Xiao, Yoshiharu IshikawaVLDB 2022 · 被引用 70 次
- R2LSH: A Nearest Neighbor Search Scheme Based on Two-dimensional Projected SpacesKejing Lu, Mineichi KudoICDE 2020 · 被引用 40 次
- Norm-Explicit Quantization: Improving Vector Quantization for Maximum Inner Product SearchXinyan Dai, Xiao Yan, Kelvin Kai Wing Ng, Jiu Liu 等AAAI 2020 · 被引用 34 次
- Point-to-Hyperplane Nearest Neighbor Search Beyond the Unit HypersphereQiang Huang, Yifan Lei, Anthony K. H. TungSIGMOD 2021 · 被引用 17 次
相关 Paper
- PM-LSH: A Fast and Accurate LSH Framework for High-Dimensional Approximate NN SearchBolong Zheng, Xi Zhao, Lianggui Weng, Nguyen Quoc Viet Hung 等VLDB 2020 · 被引用 64 次
- VHP: Approximate Nearest Neighbor Search via Virtual Hypersphere PartitioningKejing Lu, Hongya Wang, Wei Wang, Mineichi KudoVLDB 2020 · 被引用 9 次
- DB-LSH: Locality-Sensitive Hashing with Query-based Dynamic BucketingYao Tian, Xi Zhao, Xiaofang ZhouICDE 2022 · 被引用 21 次
- MP-RW-LSH: An Efficient Multi-Probe LSH Solution to ANNS-L_1Huayi Wang, Jingfan Meng, Long Gong, Jun Xu 等VLDB 2021 · 被引用 3 次
- DET-LSH: A Locality-Sensitive Hashing Scheme with Dynamic Encoding Tree for Approximate Nearest Neighbor SearchJiuqi Wei, Botao Peng, Xiaodong Lee, Themis PalpanasVLDB 2024 · 被引用 35 次
