Beyond L1: Faster and Better Sparse Models with skglm
Quentin Bertrand, Quentin Klopfenstein, Pierre-Antoine Bannier, Gauthier Gidel, Mathurin Massias
Abstract
We propose a new fast algorithm to estimate any sparse generalized linear model with convex or non-convex separable penalties. Our algorithm is able to solve problems with millions of samples and features in seconds, by relying on coordinate descent, working sets and Anderson acceleration. It handles previously unaddressed models, and is extensively shown to improve state-of-art algorithms. We release skglm, a flexible, scikit-learn compatible package, which easily handles customized datafits and penalties.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 874ae12a-c79b-4544-b2b2-b203e455dc16Cited by top-tier papers3
- Benchopt: Reproducible, efficient and collaborative optimization benchmarksThomas Moreau, Mathurin Massias, Alexandre Gramfort, Pierre Ablin et al.NeurIPS 2022 · 58 citations
- Conformalization of Sparse Generalized Linear ModelsEtash Kumar Guha, Eugène Ndiaye, Xiaoming HuoICML 2023 · 4 citations
- FastSurvival: Hidden Computational Blessings in Training Cox Proportional Hazards ModelsJiachang Liu, Rui Zhang, Cynthia RudinNeurIPS 2024 · 1 citation
Builds on3
- Implicit differentiation of Lasso-type models for hyperparameter optimizationQuentin Bertrand, Quentin Klopfenstein, Mathieu Blondel, Samuel Vaiter et al.ICML 2020 · 73 citations
- Anderson Acceleration of Proximal Gradient MethodsVien V. Mai, Mikael JohanssonICML 2020 · 45 citations
- Stochastic Anderson Mixing for Nonconvex Stochastic OptimizationFuchao Wei, Chenglong Bao, Yang LiuNeurIPS 2021 · 27 citations
Related papers
- Robust Regression Revisited: Acceleration and Improved Estimation RatesArun Jambulapati, Jerry Li, Tselil Schramm, Kevin TianNeurIPS 2021 · 18 citations
- Enhanced Cyclic Coordinate Descent Methods for Elastic Net Penalized Linear ModelsYixiao Wang, Zishan Shao, Ting Jiang, Aditya DevarakondaNeurIPS 2025 · 3 citations
- Learning No-Regret Sparse Generalized Linear Models with Varying Observation(s)Diyang Li, Charles Ling, Zhiqiang Xu, Huan Xiong et al.ICLR 2024
- NysADMM: faster composite convex optimization via low-rank approximationShipu Zhao, Zachary Frangella, Madeleine UdellICML 2022 · 10 citations
- GRAND-SLAMIN' Interpretable Additive Modeling with Structural ConstraintsShibal Ibrahim, Gabriel Afriat, Kayhan Behdin, Rahul MazumderNeurIPS 2023 · 15 citations
