Through the Lens of Hubness: A Revisit on Graph-Based Approximate Nearest Neighbor Search: [Experiments & Analysis]
Xiaoliang Xu, Haonan Dai, Can Li, Mengzhao Wang, Qiang Yue
Abstract
Graph-based Approximate Nearest Neighbor Search (ANNS) is a cornerstone of modern AI systems; however, its practical utility is undermined by a severe long-tail latency problem in which outlier queries jeopardize Service-Level Objectives (SLOs). This paper presents the first systematic study to establish the hubness phenomenon, an intrinsic property of high-dimensional data, as the fundamental cause of this performance instability. Our theoretical analysis reveals that hubness induces topologically skewed proximity graphs, characterized by overly centralized hubs and isolated anti-hubs. This topological imbalance invalidates the greedy traversal heuristic underpinning graph-based search, explaining why queries targeting anti-hubs become performance outliers. We propose a unified framework that deconstructs mainstream ANNS algorithms, reinterpreting their designs as a taxonomy of distinct hubness-mitigation strategies. Extensive experiments on datasets scaling up to 100 million vectors validate this framework, linking an algorithm's mitigation strategy to its effectiveness in balancing graph topology and optimizing outlier performance. Furthermore, our analysis uncovers critical design challenges, specifically the inherent trade-off between suppressing hubs and ensuring the reachability of anti-hubs. Building on these insights, we introduce a hubness-aware pruning optimization that efficiently refines graph topology. This approach yields performance improvements with negligible processing overhead, validating the potential of designing robust graph-based ANNS indexes by integrating hubness information.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- Empowering Graph-based Approximate Nearest Neighbor Search with Adaptive Awareness CapabilitiesJiancheng Ruan, Tingyang Chen, Renchi Yang, Xiangyu Ke et al.KDD 2025 · 2 citations
- Angular Distance-Guided Neighbor Selection for Graph-Based Approximate Nearest Neighbor SearchSungjun Jung, Yongsang Park, Haeun Lee, Young H. Oh et al.WWW 2025 · 3 citations
- Boosting Accuracy and Efficiency for Vector Retrieval with Local Scaling GraphHongya Wang, Wenlong Wu, Cong Luo, Aobei Bian et al.ICDE 2025 · 2 citations
- Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional SpacesXi Zhao, Yao Tian, Kai Huang, Bolong Zheng et al.VLDB 2023 · 88 citations
- A Topology-Aware Localized Update Strategy for Graph-Based ANN IndexSong Yu, Shengyuan Lin, Shufeng Gong, Yongqing Xie et al.VLDB 2026 · 10 citations
