Lorentz Local Canonicalization: How to make any Network Lorentz-Equivariant
Jonas Spinner, Luigi Favaro, Peter Lippmann, Sebastian Pitz, Gerrit Gerhartz, Tilman Plehn, Fred A. Hamprecht
Abstract
Lorentz-equivariant neural networks are becoming the leading architectures for high-energy physics. Current implementations rely on specialized layers, limiting architectural choices. We introduce Lorentz Local Canonicalization (LLoCa), a general framework that renders any backbone network exactly Lorentz-equivariant. Using equivariantly predicted local reference frames, we construct LLoCa-transformers and graph networks. We adapt a recent approach for geometric message passing to the non-compact Lorentz group, allowing propagation of space-time tensorial features. Data augmentation emerges from LLoCa as a special choice of reference frame. Our models achieve competitive and state-of-the-art accuracy on relevant particle physics tasks, while being faster and using fewer FLOPs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0d99d1b2-4236-4cc8-a7e2-1f6d63bb10b4Cited by top-tier papers2
- ReViT: Rotational-equivariant Vision Transformers for Neural PDE SolversHao Wei, Björn List, Nils ThuereyICML 2026
- Take Note: Your Molecular Dataset Is Probably AlignedPeter Lippmann, Roman Remme, Manuel Viktor Klockow, Fred A. HamprechtICLR 2026
Builds on14
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessTri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra et al.NeurIPS 2022 · 5,493 citations
- Going deeper with Image TransformersHugo Touvron, Matthieu Cord, Alexandre Sablayrolles, Gabriel Synnaeve et al.ICCV 2021 · 1,279 citations
- Particle Transformer for Jet TaggingHuilin Qu, Congqiao Li, Sitian QianICML 2022 · 187 citations
- Scalars are universal: Equivariant machine learning, structured like classical physicsSoledad Villar, David W. Hogg, Kate Storey-Fisher, Weichi Yao et al.NeurIPS 2021 · 185 citations
- Frame Averaging for Invariant and Equivariant Network DesignOmri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra et al.ICLR 2022 · 177 citations
Related papers
- Lorentz-Equivariant Geometric Algebra Transformers for High-Energy PhysicsJonas Spinner, Victor Bresó, Pim de Haan, Tilman Plehn et al.NeurIPS 2024 · 65 citations
- Beyond Canonicalization: How Tensorial Messages Improve Equivariant Message PassingPeter Lippmann, Gerrit Gerhartz, Roman Remme, Fred A. HamprechtICLR 2025
- Lorentz Group Equivariant Neural Network for Particle PhysicsAlexander Bogatskiy, Brandon M. Anderson, Jan T. Offermann, Marwah Roussi et al.ICML 2020 · 164 citations
- Equivariance via Minimal Frame Averaging for More Symmetries and EfficiencyYuchao Lin, Jacob Helwig, Shurui Gui, Shuiwang JiICML 2024 · 20 citations
- SE(3) Equivariant Graph Neural Networks with Complete Local FramesWeitao Du, He Zhang, Yuanqi Du, Qi Meng et al.ICML 2022 · 111 citations
