VDHA: Vector-Driven Hash Aggregation for Sparse Matrix-Sparse Vector Multiplication on GPUs
Yuchen Li, Zhe Pan, Peng Qu, Youhui Zhang
摘要
Sparse matrix-sparse vector multiplication (SpMSpV) is a core primitive in graph analytics and scientific computing, also arising in spiking neural networks for event-driven spike propagation. On GPUs, the performance of the prevalent and efficient SpMSpV paradigm is often bottlenecked by the write-back phase of accumulating non-zero multiply–accumulate results; its many-to-one index scatter pattern causes severe conflicts and poor bandwidth utilization on GPUs. We present VDHA, a GPU-based weighted SpMSpV kernel that leverages block-private hash tables for local aggregation, substantially reducing write conflicts and improving memory coalescing. To further amplify this benefit, we incorporate column splitting with lightweight reordering to expose more locality, and employ a fetch–compute–writeback pipeline to overlap hash computation with memory accesses. Extensive evaluation on over 300 matrices with more than 5 million nonzeros, including web-scale graphs (Konect/LAW) and scientific workloads (SuiteSparse), shows that VDHA consistently outperforms state-of-the-art baselines. On web graphs, it achieves a 1.41× geometric-mean speedup (up to 3.42×), while on SuiteSparse it delivers 1.13× (up to 2.55×). We also provide a lightweight predictive model that identifies matrices favorable to VDHA with 91.3% accuracy.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- HAM-SpMSpV: an Optimized Parallel Algorithm for Masked Sparse Matrix-Sparse Vector Multiplications on multi-core CPUsLei Xu, Haipeng Jia, Yunquan Zhang, Luhan Wang 等HPDC 2024 · 被引用 2 次
- A novel data transformation and execution strategy for accelerating sparse matrix multiplication on GPUsPeng Jiang, Changwan Hong, Gagan AgrawalPPoPP 2020 · 被引用 74 次
- A Row Decomposition-based Approach for Sparse Matrix Multiplication on GPUsMeng Pang, Xiang Fei, Peng Qu, Youhui Zhang 等PPoPP 2024 · 被引用 29 次
- HSMU-SpGEMM: Achieving High Shared Memory Utilization for Parallel Sparse General Matrix-Matrix Multiplication on Modern GPUsMin Wu, Huizhang Luo, Fenfang Li, Yiran Zhang 等HPCA 2025 · 被引用 3 次
- GPUs All Grown-Up: Fully Device-Driven SpMV Using GPU Work GraphsFabian Wildgrube, Pete Ehrett, Paul Trojahn, Richard Membarth 等ISCA 2025 · 被引用 3 次
