GraphTER: Unsupervised Learning of Graph Transformation Equivariant Representations via Auto-Encoding Node-Wise Transformations
Xiang Gao, Wei Hu, Guo-Jun Qi
Abstract
Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature representations in an unsupervised manner in practice. To this end, we propose a novel unsupervised learning of Graph Transformation Equivariant Representations (GraphTER), aiming to capture intrinsic patterns of graph structure under both global and local transformations. Specifically, we allow to sample different groups of nodes from a graph and then transform them node-wise isotropically or anisotropically. Then, we self-train a representation encoder to capture the graph structures by reconstructing these node-wise transformations from the feature representations of the original and transformed graphs. In experiments, we apply the learned GraphTER to graphs of 3D point cloud data, and results on point cloud segmentation/classification show that Graph-TER significantly outperforms state-of-the-art unsupervised approaches and pushes greatly closer towards the upper bound set by the fully supervised counterparts. The code is available at: https://github.com/gyshgx868/graph-ter .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d1b538d5-4e18-4f49-a627-5eaa79f328aaCited by top-tier papers11
- Differentiable Manifold Reconstruction for Point Cloud DenoisingShitong Luo, Wei HuACM MM 2020 · 123 citations
- Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud LearningBi'an Du, Xiang Gao, Wei Hu, Xin LiACM MM 2021 · 82 citations
- Isometric 3D Adversarial Examples in the Physical WorldYibo Miao, Yinpeng Dong, Jun Zhu, Xiao-Shan GaoNeurIPS 2022 · 45 citations
- DHGCN: Dynamic Hop Graph Convolution Network for Self-Supervised Point Cloud LearningJincen Jiang, Lizhi Zhao, Xuequan Lu, Wei Hu et al.AAAI 2024 · 21 citations
- Improving Robustness of 3D Point Cloud Recognition from a Fourier PerspectiveYibo Miao, Yinpeng Dong, Jinlai Zhang, Lijia Yu et al.NeurIPS 2024 · 15 citations
Builds on2
- Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds From Multiple Angles by Joint Self-Reconstruction and Half-to-Half PredictionZhizhong Han, Xiyang Wang, Yu-Shen Liu, Matthias ZwickerICCV 2019 · 153 citations
- AVT: Unsupervised Learning of Transformation Equivariant Representations by Autoencoding Variational TransformationsGuo-Jun Qi, Liheng Zhang, Chang Wen Chen, Qi TianICCV 2019 · 44 citations
Related papers
- Rotation-Invariant Local-to-Global Representation Learning for 3D Point CloudSeohyun Kim, Jaeyoo Park, Bohyung HanNeurIPS 2020 · 92 citations
- VV-Net: Voxel VAE Net With Group Convolutions for Point Cloud SegmentationHsien-Yu Meng, Lin Gao, Yu-Kun Lai, Dinesh ManochaICCV 2019 · 268 citations
- Convolution in the Cloud: Learning Deformable Kernels in 3D Graph Convolution Networks for Point Cloud AnalysisZhi-Hao Lin, Sheng-Yu Huang, Yu-Chiang Frank WangCVPR 2020
- Isometric Transformation Invariant and Equivariant Graph Convolutional NetworksMasanobu Horie, Naoki Morita, Toshiaki Hishinuma, Yu Ihara et al.ICLR 2021 · 25 citations
- PointClustering: Unsupervised Point Cloud Pre-training using Transformation Invariance in ClusteringFuchen Long, Ting Yao, Zhaofan Qiu, Lusong Li et al.CVPR 2023
