LAN: Learning-based Approximate k-Nearest Neighbor Search in Graph Databases
Yun Peng, Byron Choi, Tsz Nam Chan, Jianliang Xu
Abstract
The problem of k-nearest neighbor (k-NN) search is fundamental in graph databases, which has numerous real-world applications, such as bioinformatics, computer vision, and software engineering. Graph edit distance (GED) and maximum common subgraph (MCS)-based distance are the most widely used distance measures in k-NN search. However, computing the exact k-NNs of a query graphusing these measures is prohibitively time-consuming, as a large number of graph distance computations is needed, and computing GED and MCS are both NP-hard. In this paper, we study the approximate k-nearest neighbor (k-ANN) search with the aim of trading efficiency with a slight decrease in accuracy. Greedy routing on the proximity graph (PG) index is a state-of-the-art method for k-ANN search. However, such routing algorithms are not designed for graph databases, and simple adoption is inefficient. The core reason is that the exhaustive neighbor exploration at each routing step incurs a large number of distance computations (NDC). In this paper, we propose a learning-based k-ANN search method to reduce NDC. First, we propose to prune unpromising neighbors from distance computations. We use a graph learning model to rank the neighbors at each routing step and explore only the top neighbors. For the accuracy of rank prediction, we propose a neighbor ranking model that works only in the neighborhood of Q. Second, we propose a learning-based method to select the initial node for the routing. The initial node selected has a high probability of being in the neighborhood of Q, such that the neighbor ranking model can be used. Third, we propose a compressed GNN-graph to accelerate the neighbor ranking model and the initial node selection model. We prove that learning efficiency is improved without degrading the accuracy. Our extensive experiments show that our method is about 3.6x to 18.6x faster than the state-of-the-art methods on real-world datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2ea483ce-468b-4a29-b753-a2b20f9d7024Cited by top-tier papers4
- Efficient Approximate Nearest Neighbor Search in Multi-dimensional DatabasesYun Peng, Byron Choi, Tsz Nam Chan, Jianye Yang et al.SIGMOD 2023 · 74 citations
- DET-LSH: A Locality-Sensitive Hashing Scheme with Dynamic Encoding Tree for Approximate Nearest Neighbor SearchJiuqi Wei, Botao Peng, Xiaodong Lee, Themis PalpanasVLDB 2024 · 35 citations
- Routing-Guided Learned Product Quantization for Graph-Based Approximate Nearest Neighbor SearchQiang Yue, Xiaoliang Xu, Yuxiang Wang, Yikun Tao et al.ICDE 2024 · 5 citations
- FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion DistancesJunjie Song, Yu Liu, Guoyu Hu, Zhongle Xie et al.SIGMOD 2026 · 1 citation
Builds on14
- A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor SearchMengzhao Wang, Xiaoliang Xu, Qiang Yue, Yuxiang WangVLDB 2021 · 354 citations
- Degree-Quant: Quantization-Aware Training for Graph Neural NetworksShyam Anil Tailor, Javier Fernández-Marqués, Nicholas Donald LaneICLR 2021 · 180 citations
- Learning-Based Efficient Graph Similarity Computation via Multi-Scale Convolutional Set MatchingYunsheng Bai, Hao Ding, Ken Gu, Yizhou Sun et al.AAAI 2020 · 130 citations
- SONG: Approximate Nearest Neighbor Search on GPUWeijie Zhao, Shulong Tan, Ping LiICDE 2020 · 103 citations
- Improving Approximate Nearest Neighbor Search through Learned Adaptive Early TerminationConglong Li, Minjia Zhang, David G. Andersen, Yuxiong HeSIGMOD 2020 · 86 citations
Related papers
- GHashing: Semantic Graph Hashing for Approximate Similarity Search in Graph DatabasesZongyue Qin, Yunsheng Bai, Yizhou SunKDD 2020 · 29 citations
- Angular Distance-Guided Neighbor Selection for Graph-Based Approximate Nearest Neighbor SearchSungjun Jung, Yongsang Park, Haeun Lee, Young H. Oh et al.WWW 2025 · 3 citations
- Relative NN-Descent: A Fast Index Construction for Graph-Based Approximate Nearest Neighbor SearchNaoki Ono, Yusuke MatsuiACM MM 2023 · 14 citations
- Interpretable Graph Similarity Computation via Differentiable Optimal Alignment of Node EmbeddingsKhoa D. Doan, Saurav Manchanda, Suchismit Mahapatra, Chandan K. ReddySIGIR 2021 · 26 citations
- CSPG: Crossing Sparse Proximity Graphs for Approximate Nearest Neighbor SearchMing Yang, Yuzheng Cai, Weiguo ZhengNeurIPS 2024 · 14 citations
