Repelling Random Walks
Isaac Reid, Eli Berger, Krzysztof Marcin Choromanski, Adrian Weller
Abstract
We present a novel quasi-Monte Carlo mechanism to improve graph-based sampling, coined repelling random walks. By inducing correlations between the trajectories of an interacting ensemble such that their marginal transition probabilities are unmodified, we are able to explore the graph more efficiently, improving the concentration of statistical estimators whilst leaving them unbiased. The mechanism has a trivial drop-in implementation. We showcase the effectiveness of repelling random walks in a range of settings including estimation of graph kernels, the PageRank vector and graphlet concentrations. We provide detailed experimental evaluation and robust theoretical guarantees. To our knowledge, repelling random walks constitute the first rigorously studied quasi-Monte Carlo scheme correlating the directions of walkers on a graph, inviting new research in this exciting nascent domain. 1 * Senior lead.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Computationally-efficient Graph Modeling with Refined Graph Random FeaturesKrzysztof Choromanski, Kumar Avinava Dubey, Arijit Sehanobish, Isaac ReidICML 2026 · 2 citations
- Variance-Reducing Couplings for Random FeaturesIsaac Reid, Stratis Markou, Krzysztof Marcin Choromanski, Richard E. Turner et al.ICLR 2025
- Linear Transformer Topological Masking with Graph Random FeaturesIsaac Reid, Kumar Avinava Dubey, Deepali Jain, William F. Whitney et al.ICLR 2025
Builds on6
- Rethinking Attention with PerformersKrzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song et al.ICLR 2021 · 122 citations
- Taming graph kernels with random featuresKrzysztof Marcin ChoromanskiICML 2023 · 21 citations
- Quasi-Monte Carlo Graph Random FeaturesIsaac Reid, Adrian Weller, Krzysztof Marcin ChoromanskiNeurIPS 2023 · 11 citations
- Simplex Random FeaturesIsaac Reid, Krzysztof Marcin Choromanski, Valerii Likhosherstov, Adrian WellerICML 2023 · 10 citations
- Learning Manifold Implicitly via Explicit Heat-Kernel LearningYufan Zhou, Changyou Chen, Jinhui XuNeurIPS 2020 · 9 citations
Related papers
- Self-Repellent Random Walks on General Graphs - Achieving Minimal Sampling Variance via Nonlinear Markov ChainsVishwaraj Doshi, Jie Hu, Do Young EunICML 2023 · 6 citations
- Beyond Self-Repellent Kernels: History-Driven Target Towards Efficient Nonlinear MCMC on General GraphsJie Hu, Yi-Ting Ma, Do Young EunICML 2025
- Efficient Personalized PageRank Computation: The Power of Variance-Reduced Monte Carlo ApproachesMeihao Liao, Rong-Hua Li, Qiangqiang Dai, Hongyang Chen et al.SIGMOD 2023 · 15 citations
- Efficient Estimation of Pairwise Effective ResistanceRenchi Yang, Jing TangSIGMOD 2023 · 15 citations
- Efficient Personalized PageRank Computation: A Spanning Forests Sampling Based ApproachMeihao Liao, Rong-Hua Li, Qiangqiang Dai, Guoren WangSIGMOD 2022 · 16 citations
