PointDGRWKV: Generalizing RWKV-like Architecture to Unseen Domains for Point Cloud Classification
Hao Yang, Qianyu Zhou, Haijia Sun, Xiangtai Li, Xuequan Lu, Lizhuang Ma, Shuicheng Yan
摘要
Domain Generalization (DG) has been recently explored to enhance the generalizability of Point Cloud Classification (PCC) models toward unseen domains. Prior works are based on convolutional networks, Transformer or Mamba architectures, either suffering from limited receptive fields or high computational cost, or insufficient long-range dependency modeling. RWKV, as an emerging architecture, possesses superior linear complexity, global receptive fields, and long-range dependency. In this paper, we present the first work that studies the generalizability of RWKV models in DG PCC. We find that directly applying RWKV to DG PCC encounters two significant challenges: RWKV's fixed direction token shift methods, like Q-Shift, introduce spatial distortions when applied to unstructured point clouds, weakening local geometric modeling and reducing robustness. In addition, the Bi-WKV attention in RWKV amplifies slight cross-domain differences in key distributions through exponential weighting, leading to attention shifts and degraded generalization. To this end, we propose PointDGRWKV, the first RWKV-based framework tailored for DG PCC. It introduces two core modules to enhance spatial modeling and cross-domain robustness, while maintaining RWKV's linear efficiency. In particular, we present Adaptive Geometric Token Shift to model local neighborhood structures to improve geometric context awareness. In addition, Cross-Domain key feature Distribution Alignment is designed to mitigate attention drift by aligning key feature distributions across domains. Extensive experiments on multiple benchmarks demonstrate that PointDGRWKV achieves state-of-the-art performance on DG PCC.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper30
- PointNeXt: Revisiting PointNet++ with Improved Training and Scaling StrategiesGuocheng Qian, Yuchen Li, Houwen Peng, Jinjie Mai 等NeurIPS 2022 · 被引用 1,270 次
- Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World DataMikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Duc Thanh Nguyen 等ICCV 2019 · 被引用 1,003 次
- PointMamba: A Simple State Space Model for Point Cloud AnalysisDingkang Liang, Xin Zhou, Wei Xu, Xingkui Zhu 等NeurIPS 2024 · 被引用 380 次
- Benchmarking and Analyzing Point Cloud Classification under CorruptionsJiawei Ren, Liang Pan, Ziwei LiuICML 2022 · 被引用 114 次
- Point Cloud Mamba: Point Cloud Learning via State Space ModelTao Zhang, Haobo Yuan, Lu Qi, Jiangning Zhang 等AAAI 2025 · 被引用 110 次
相关 Paper
- RWKV3D: An RWKV-Based Model with Multiple Training Strategies for Point Cloud AnalysisChenglong Sun, Shijie Pang, Yuzheng Wang, Lizhe QiACM MM 2025
- PointRWKV: Efficient RWKV-Like Model for Hierarchical Point Cloud LearningQingdong He, Jiangning Zhang, Jinlong Peng, Haoyang He 等AAAI 2025 · 被引用 41 次
- PointDGMamba: Domain Generalization of Point Cloud Classification via Generalized State Space ModelHao Yang, Qianyu Zhou, Haijia Sun, Xiangtai Li 等AAAI 2025 · 被引用 3 次
- Learning Generalizable Part-based Feature Representation for 3D Point CloudsXin Wei, Xiang Gu, Jian SunNeurIPS 2022 · 被引用 24 次
- DAPoinTr: Domain Adaptive Point Transformer for Point Cloud CompletionYinghui Li, Qianyu Zhou, Jingyu Gong, Ye Zhu 等AAAI 2025 · 被引用 4 次
