PointDGRWKV: Generalizing RWKV-like Architecture to Unseen Domains for Point Cloud Classification
Hao Yang, Qianyu Zhou, Haijia Sun, Xiangtai Li, Xuequan Lu, Lizhuang Ma, Shuicheng Yan
Abstract
Domain Generalization (DG) has been recently explored to enhance the generalizability of Point Cloud Classification (PCC) models toward unseen domains. Prior works are based on convolutional networks, Transformer or Mamba architectures, either suffering from limited receptive fields or high computational cost, or insufficient long-range dependency modeling. RWKV, as an emerging architecture, possesses superior linear complexity, global receptive fields, and long-range dependency. In this paper, we present the first work that studies the generalizability of RWKV models in DG PCC. We find that directly applying RWKV to DG PCC encounters two significant challenges: RWKV's fixed direction token shift methods, like Q-Shift, introduce spatial distortions when applied to unstructured point clouds, weakening local geometric modeling and reducing robustness. In addition, the Bi-WKV attention in RWKV amplifies slight cross-domain differences in key distributions through exponential weighting, leading to attention shifts and degraded generalization. To this end, we propose PointDGRWKV, the first RWKV-based framework tailored for DG PCC. It introduces two core modules to enhance spatial modeling and cross-domain robustness, while maintaining RWKV's linear efficiency. In particular, we present Adaptive Geometric Token Shift to model local neighborhood structures to improve geometric context awareness. In addition, Cross-Domain key feature Distribution Alignment is designed to mitigate attention drift by aligning key feature distributions across domains. Extensive experiments on multiple benchmarks demonstrate that PointDGRWKV achieves state-of-the-art performance on DG PCC.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on30
- PointNeXt: Revisiting PointNet++ with Improved Training and Scaling StrategiesGuocheng Qian, Yuchen Li, Houwen Peng, Jinjie Mai et al.NeurIPS 2022 · 1,270 citations
- Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World DataMikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Duc Thanh Nguyen et al.ICCV 2019 · 1,003 citations
- PointMamba: A Simple State Space Model for Point Cloud AnalysisDingkang Liang, Xin Zhou, Wei Xu, Xingkui Zhu et al.NeurIPS 2024 · 380 citations
- Benchmarking and Analyzing Point Cloud Classification under CorruptionsJiawei Ren, Liang Pan, Ziwei LiuICML 2022 · 114 citations
- Point Cloud Mamba: Point Cloud Learning via State Space ModelTao Zhang, Haobo Yuan, Lu Qi, Jiangning Zhang et al.AAAI 2025 · 110 citations
Related papers
- RWKV3D: An RWKV-Based Model with Multiple Training Strategies for Point Cloud AnalysisChenglong Sun, Shijie Pang, Yuzheng Wang, Lizhe QiACM MM 2025
- PointRWKV: Efficient RWKV-Like Model for Hierarchical Point Cloud LearningQingdong He, Jiangning Zhang, Jinlong Peng, Haoyang He et al.AAAI 2025 · 41 citations
- PointDGMamba: Domain Generalization of Point Cloud Classification via Generalized State Space ModelHao Yang, Qianyu Zhou, Haijia Sun, Xiangtai Li et al.AAAI 2025 · 3 citations
- Learning Generalizable Part-based Feature Representation for 3D Point CloudsXin Wei, Xiang Gu, Jian SunNeurIPS 2022 · 24 citations
- DAPoinTr: Domain Adaptive Point Transformer for Point Cloud CompletionYinghui Li, Qianyu Zhou, Jingyu Gong, Ye Zhu et al.AAAI 2025 · 4 citations
