Differentiable Clustering with Perturbed Spanning Forests
Lawrence Stewart, Francis R. Bach, Felipe Llinares-López, Quentin Berthet
Abstract
We introduce a differentiable clustering method based on minimum-weight spanning forests, a variant of spanning trees with several connected components. Our method relies on stochastic perturbations of solutions of linear programs, for smoothing and efficient gradient computations. This allows us to include clustering in end-to-end trainable pipelines. We show that our method performs well even in difficult settings, such as datasets with high noise and challenging geometries. We also formulate an ad hoc loss to efficiently learn from partial clustering data using this operation. We demonstrate its performance on several real world datasets for supervised and semi-supervised tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 16035a7f-0e1c-4e14-b247-d7d5bab36f79Cited by top-tier papers6
- Uncertainty Quantification via Stable Distribution PropagationFelix Petersen, Aashwin Ananda Mishra, Hilde Kuehne, Christian Borgelt et al.ICLR 2024 · 11 citations
- DistrictNet: Decision-aware learning for geographical districtingCheikh Ahmed, Alexandre Forel, Axel Parmentier, Thibaut VidalNeurIPS 2024 · 5 citations
- Generalizing Stochastic Smoothing for Differentiation and Gradient EstimationFelix Petersen, Christian Borgelt, Aashwin Mishra, Stefano ErmonICML 2026 · 4 citations
- CF-OPT: Counterfactual Explanations for Structured PredictionGermain Vivier-Ardisson, Alexandre Forel, Axel Parmentier, Thibaut VidalICML 2024 · 3 citations
- Bregman Conditional Random Fields: Sequence Labeling with Parallelizable Inference AlgorithmsCaio Corro, Mathieu Lacroix, Joseph Le RouxACL 2025
Builds on14
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Efficient and Modular Implicit DifferentiationMathieu Blondel, Quentin Berthet, Marco Cuturi, Roy Frostig et al.NeurIPS 2022 · 386 citations
- Differentiation of Blackbox Combinatorial SolversMarin Vlastelica Pogancic, Anselm Paulus, Vít Musil, Georg Martius et al.ICLR 2020 · 341 citations
- Fast Differentiable Sorting and RankingMathieu Blondel, Olivier Teboul, Quentin Berthet, Josip DjolongaICML 2020 · 285 citations
- Learning with Differentiable Pertubed OptimizersQuentin Berthet, Mathieu Blondel, Olivier Teboul, Marco Cuturi et al.NeurIPS 2020 · 181 citations
Related papers
- End-to-end Differentiable Clustering with Associative MemoriesBishwajit Saha, Dmitry Krotov, Mohammed J. Zaki, Parikshit RamICML 2023 · 14 citations
- Spectral Clustering with Graph Neural Networks for Graph PoolingFilippo Maria Bianchi, Daniele Grattarola, Cesare AlippiICML 2020 · 528 citations
- Approximate Forest Completion and Learning-Augmented Algorithms for Metric Minimum Spanning TreesNate Veldt, Thomas Stanley, Benjamin W. Priest, Trevor Steil et al.ICML 2025
- Learning Binary Decision Trees by Argmin DifferentiationValentina Zantedeschi, Matt J. Kusner, Vlad NiculaeICML 2021 · 16 citations
- End-to-End Learning for Graph DecompositionJie Song, Bjoern Andres, Michael J. Black, Otmar Hilliges et al.ICCV 2019 · 16 citations
