Lune

ICDE2024Top-tier venue

Efficient Reverse k Approximate Nearest Neighbor Search Over High-Dimensional Vectors

Yitong Song, Kai Wang, Bin Yao, Zhida Chen, Jiong Xie, Feifei Li

2024Year
3Citations
1Top-tier citations

Abstract

Reversekknearest neighbor search(RkNNS)(\mathbf{R}k\mathbf{NNS})plays an important role in various data processing and analysis tasks, seeking to pinpoint data considering the query dataqqamong theirkknearest neighbors. As large models gain popularity, processing high-dimensional vectors has become more and more widespread. However, existingRkNNS\mathbf{R}k\mathbf{NNS}solutions face inefficiency when handling large-scale high-dimensional vectors due to their sensitivity to data dimensions and sizes during index construction or the verification of numerous candidate results in the query phase. Motivated by these challenges and the inherent intricacies of high-dimensional data processing, in this paper, we study an approximate version of theRkNNS\mathbf{R}k\mathbf{NNS}problem(RkANNS)(\mathbf{R}k\mathbf{ANNS})for high-dimensional vectors, aiming to offer efficient and practical solutions. To this end, we propose a new proximity-graph-based index called HAMG, which enables finding the query results withinkkhops fromqq. We also present a user-friendly query algorithm on HAMG that can adaptively adjust the search scope based on the desired query recall of users. To further enhance the query process, two pruning strategies are proposed to reduce the number of candidates requiring verification. Extensive experiments validate that HAMG scales well for data dimensions and sizes, and our query algorithm improves query efficiency by up to two orders of magnitude while maintaining comparable query accuracy against existing approaches.

Ask about this paper

Ask your agent about it.

Lune has read the top-tier papers around this one, so every answer names the papers it rests on.

Questions to start from

Your agent calls

Lunesearch_papers

Ask in Lune

Free to start. No credit card required.

lune papers get 0e227bd4-4bd2-472b-97ca-9b650b447b5c

Cited by top-tier papers1

Ask how each one uses it

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines