Unsupervised Identification of Protein Compositions and Conformations Via Implicit Content-Transformation Disentanglement
Mostofa Rafid Uddin, Jana Armouti, Min Xu
摘要
Identifying different protein compositions and conformations from microscopic images of protein mixtures is a challenging open problem. We address this through disentangled representation learning, where separating protein compositions and conformations in an intermediate latent space enables accurate identification. By modeling compositions and conformations as content and transformation, the task can be reduced to disentangling content and transformation. The existing disentangling methods require an explicit parametric form for the transformation, which is unavailable for conformation, making these methods unsuitable. To overcome this limitation, we propose Dual-Contrast, a novel contrastive learning-based method that implicitly parameterizes and disentangles both transformation and content. DualContrast achieves this by generating positive and negative pairs for content and transformation in both data and latent spaces. We demonstrate that existing self-supervised approaches fail under similar implicit parameterization, underscoring the necessity of our method. Through extensive experiments on 3D microscopic images of protein mixtures and additional shape-focused datasets beyond microscopy, we validate our claims and demonstrate the first in-principle fully unsupervised identification of different protein compositions and conformations in 3D microscopic images.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun 等ICML 2021 · 被引用 2,942 次
- Self-Supervised Learning with Data Augmentations Provably Isolates Content from StyleJulius von Kügelgen, Yash Sharma, Luigi Gresele, Wieland Brendel 等NeurIPS 2021 · 被引用 421 次
- StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion ModelsZhizhong Wang, Lei Zhao, Wei XingICCV 2023 · 被引用 219 次
- NPMs: Neural Parametric Models for 3D Deformable ShapesPablo R. Palafox, Aljaz Bozic, Justus Thies, Matthias Nießner 等ICCV 2021 · 被引用 129 次
相关 Paper
- Harmony: A Generic Unsupervised Approach for Disentangling Semantic Content from Parameterized TransformationsMostofa Rafid Uddin, Gregory Howe, Xiangrui Zeng, Min XuCVPR 2022 · 被引用 9 次
- Sample and Predict Your Latent: Modality-free Sequential Disentanglement via Contrastive EstimationIlan Naiman, Nimrod Berman, Omri AzencotICML 2023 · 被引用 12 次
- Disentangled Contrastive Learning on GraphsHaoyang Li, Xin Wang, Ziwei Zhang, Zehuan Yuan 等NeurIPS 2021 · 被引用 136 次
- Identity From Here, Pose From There: Self-Supervised Disentanglement and Generation of Objects Using Unlabeled VideosFanyi Xiao, Haotian Liu, Yong Jae LeeICCV 2019 · 被引用 16 次
- 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and FacesSimone Foti, Bongjin Koo, Danail Stoyanov, Matthew J. ClarksonCVPR 2022 · 被引用 19 次
