RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization
Alonso Urbano, David Wilson Romero, Max Zimmer, Sebastian Pokutta
Abstract
Real world data often exhibits unknown, instance-specific symmetries that rarely exactly match a transformation group fixed a priori. Class-pose decompositions aim to create disentangled representations by factoring inputs into invariant features and a pose defined relative to a training-dependent, arbitrary canonical representation. We introduce RECON, a class-pose agnostic canonical orientation normalization that corrects arbitrary canonicals via a simple right translation, yielding natural, data-aligned canonicalizations. This enables (i) unsupervised discovery of instance-specific pose distributions, (ii) detection of out-of-distribution poses and (iii) a plug-and-play test-time canonicalization layer. This layer can be attached on top of any pre-trained model to infuse group invariance, improving its performance without retraining. We validate on 2D (images) and 3D (molecular ensembles), demonstrating fine-grained, accurate pose discovery, and matching or outperforming label-supervised canonicalizations in downstream classification.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 91dd22cb-9791-468e-914b-3f30b5ea35d2Builds on28
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Geometric and Physical Quantities improve E(3) Equivariant Message PassingJohannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik J. Bekkers et al.ICLR 2022 · 307 citations
- Frame Averaging for Invariant and Equivariant Network DesignOmri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra et al.ICLR 2022 · 177 citations
- A Program to Build E(N)-Equivariant Steerable CNNsGabriele Cesa, Leon Lang, Maurice WeilerICLR 2022 · 133 citations
Related papers
- Learning to Transform for Generalizable Instance-wise InvarianceUtkarsh Singhal, Carlos Esteves, Ameesh Makadia, Stella X. YuICCV 2023 · 3 citations
- Equivariance with Learned Canonicalization FunctionsSékou-Oumar Kaba, Arnab Kumar Mondal, Yan Zhang, Yoshua Bengio et al.ICML 2023 · 109 citations
- ConDor: Self-Supervised Canonicalization of 3D Pose for Partial ShapesRahul Sajnani, Adrien Poulenard, Jivitesh Jain, Radhika Dua et al.CVPR 2022 · 28 citations
- Equivariant Adaptation of Large Pretrained ModelsArnab Kumar Mondal, Siba Smarak Panigrahi, Oumar Kaba, Sai Mudumba et al.NeurIPS 2023 · 49 citations
- Unsupervised Learning of Group Invariant and Equivariant RepresentationsRobin Winter, Marco Bertolini, Tuan Le, Frank Noé et al.NeurIPS 2022 · 61 citations
