FILTR: Extracting Topological Features from Pretrained 3D Models
Louis Martinez, Maks Ovsjanikov
摘要
Recent advances in pretraining 3D point cloud encoders (e.g., Point-BERT, Point-MAE) have produced powerful models, whose abilities are typically evaluated on geometric or semantic tasks. At the same time, topological descriptors have been shown to provide informative summaries of a shape's multiscale structure. In this paper we pose the question whether topological information can be derived from features produced by 3D encoders. To address this question, we first introduce DONUT, a synthetic benchmark with controlled topological complexity, and propose FILTR (Filtration Transformer), a learnable framework to predict persistence diagrams directly from frozen encoders. FILTR adapts a transformer decoder to treat diagram generation as a set prediction task. Our analysis on DONUT reveals that existing encoders retain only limited global topological signals, yet FILTR successfully leverages information produced by these encoders to approximate persistence diagrams. Our approach enables, for the first time, data-driven extraction of persistence diagrams from raw point clouds through an efficient learnable feed-forward mechanism.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point ModelingXumin Yu, Lulu Tang, Yongming Rao, Tiejun Huang 等CVPR 2022 · 被引用 684 次
- An End-to-End Transformer Model for 3D Object DetectionIshan Misra, Rohit Girdhar, Armand JoulinICCV 2021 · 被引用 602 次
- Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingRenrui Zhang, Ziyu Guo, Peng Gao, Rongyao Fang 等NeurIPS 2022 · 被引用 445 次
相关 Paper
- Adaptive Topological Feature via Persistent Homology: Filtration Learning for Point CloudsNaoki Nishikawa, Yuichi Ike, Kenji YamanishiNeurIPS 2023 · 被引用 16 次
- Do Topological Characteristics Help in Knowledge Distillation?Jungeun Kim, Junwon You, Dongjin Lee, Ha Young Kim 等ICML 2024 · 被引用 11 次
- PLLay: Efficient Topological Layer based on Persistent LandscapesKwangho Kim, Jisu Kim, Manzil Zaheer, Joon Sik Kim 等NeurIPS 2020 · 被引用 34 次
- Enhancing Implicit Shape Generators Using Topological RegularizationsLiyan Chen, Yan Zheng, Yang Li, Lohit Anirudh Jagarapu 等ICML 2024 · 被引用 1 次
- TearingNet: Point Cloud Autoencoder To Learn Topology-Friendly RepresentationsJiahao Pang, Duanshun Li, Dong TianCVPR 2021
