Discovering Group Structures via Unitary Representation Learning
Dongsung Huh
摘要
Discovering group structures within data poses a fundamental challenge across diverse scientific domains. A key obstacle is the non-differentiable nature of group axioms, hindering their integration into deep learning frameworks. To address this, we introduce a novel differentiable approach leveraging the representation theory of finite groups. Our method features a unique network architecture that models interactions between group elements via matrix multiplication of their representations, along with a regularizer promoting the unitarity of these representations. The interplay between the network architecture and the unitarity condition implicitly encourages the emergence of valid group structures. Evaluations demonstrate our method's ability to accurately recover group operations and their unitary representations from partial observations, achieving significant improvements in sample efficiency and a ×1000 speedup over the state of the art. This work lays the foundation for a promising new paradigm in automated algebraic structure discovery, with potential applications across various domains, including automatic symmetry discovery for geometric deep learning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Achieving Approximate Symmetry Is Exponentially Easier than Exact SymmetryBehrooz Tahmasebi, Melanie WeberICLR 2026 · 被引用 8 次
- Adaptive Symmetry Discovery for Dynamical System IdentificationBehrooz Tahmasebi, Melanie WeberICML 2026 · 被引用 1 次
它引用的顶会 Paper4
- Towards Understanding Grokking: An Effective Theory of Representation LearningZiming Liu, Ouail Kitouni, Niklas Nolte, Eric J. Michaud 等NeurIPS 2022 · 被引用 299 次
- Meta-learning Symmetries by ReparameterizationAllan Zhou, Tom Knowles, Chelsea FinnICLR 2021 · 被引用 105 次
- Progress measures for grokking via mechanistic interpretabilityNeel Nanda, Lawrence Chan, Tom Lieberum, Jess Smith 等ICLR 2023 · 被引用 54 次
- Generative Adversarial Symmetry DiscoveryJianke Yang, Robin Walters, Nima Dehmamy, Rose YuICML 2023 · 被引用 41 次
相关 Paper
- MatrixNet: Learning over symmetry groups using learned group representationsLucas Laird, Circe Hsu, Asilata Bapat, Robin WaltersNeurIPS 2024 · 被引用 2 次
- Interpretable Discovery of One-parameter Subgroups: A Modular Framework for Elliptical, Hyperbolic, and Parabolic SymmetriesPavan Karjol, Vivek Kashyap, Rohan Venkatesh Kashyap, Prathosh APICML 2026
- Equivariant Networks for Crystal StructuresSékou-Oumar Kaba, Siamak RavanbakhshNeurIPS 2022 · 被引用 38 次
- Automatic Symmetry Discovery with Lie Algebra Convolutional NetworkNima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang 等NeurIPS 2021 · 被引用 120 次
- Feature emergence via margin maximization: case studies in algebraic tasksDepen Morwani, Benjamin L. Edelman, Costin-Andrei Oncescu, Rosie Zhao 等ICLR 2024 · 被引用 35 次
