RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization
Alonso Urbano, David Wilson Romero, Max Zimmer, Sebastian Pokutta
摘要
Real world data often exhibits unknown, instance-specific symmetries that rarely exactly match a transformation group fixed a priori. Class-pose decompositions aim to create disentangled representations by factoring inputs into invariant features and a pose defined relative to a training-dependent, arbitrary canonical representation. We introduce RECON, a class-pose agnostic canonical orientation normalization that corrects arbitrary canonicals via a simple right translation, yielding natural, data-aligned canonicalizations. This enables (i) unsupervised discovery of instance-specific pose distributions, (ii) detection of out-of-distribution poses and (iii) a plug-and-play test-time canonicalization layer. This layer can be attached on top of any pre-trained model to infuse group invariance, improving its performance without retraining. We validate on 2D (images) and 3D (molecular ensembles), demonstrating fine-grained, accurate pose discovery, and matching or outperforming label-supervised canonicalizations in downstream classification.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper28
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
- Geometric and Physical Quantities improve E(3) Equivariant Message PassingJohannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik J. Bekkers 等ICLR 2022 · 被引用 307 次
- Frame Averaging for Invariant and Equivariant Network DesignOmri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra 等ICLR 2022 · 被引用 177 次
- A Program to Build E(N)-Equivariant Steerable CNNsGabriele Cesa, Leon Lang, Maurice WeilerICLR 2022 · 被引用 133 次
相关 Paper
- Learning to Transform for Generalizable Instance-wise InvarianceUtkarsh Singhal, Carlos Esteves, Ameesh Makadia, Stella X. YuICCV 2023 · 被引用 3 次
- Equivariance with Learned Canonicalization FunctionsSékou-Oumar Kaba, Arnab Kumar Mondal, Yan Zhang, Yoshua Bengio 等ICML 2023 · 被引用 109 次
- ConDor: Self-Supervised Canonicalization of 3D Pose for Partial ShapesRahul Sajnani, Adrien Poulenard, Jivitesh Jain, Radhika Dua 等CVPR 2022 · 被引用 28 次
- Equivariant Adaptation of Large Pretrained ModelsArnab Kumar Mondal, Siba Smarak Panigrahi, Oumar Kaba, Sai Mudumba 等NeurIPS 2023 · 被引用 49 次
- Unsupervised Learning of Group Invariant and Equivariant RepresentationsRobin Winter, Marco Bertolini, Tuan Le, Frank Noé 等NeurIPS 2022 · 被引用 61 次
