DSGCR: Decomposed Spectral Geometry-Aware Cross-Modal Semantic Representation for 3D Visual Grounding
Jing He, Licheng Jiao, Lingling Li, Xiaoqiang Lu, Xu Liu, Wenping Ma, Fang Liu, Long Sun
Abstract
3D visual grounding requires robust cross-modal representation to achieve fine-grained semantic alignment and precise geometric reasoning. However, most methods employ unimodal pre-trained encoders that transfer visual and linguistic knowledge independently, inducing domain shift and poor cross-modal alignment. Meanwhile, spatial modeling with handcrafted priors limits cross-modal geometric representation, struggling to capture complex object relations due to spectral bias. To address these challenges, we propose Text-Aware Feature Tuning (TFT) and Decomposed Spectral Geometry (DSG) to enhance cross-modal semantic representation. Specifically, TFT injects linguistic context into the visual hierarchy to mitigate domain shift and facilitate early cross-modal alignment. DSG employs a learnable Fourier basis and explicitly decomposes pairwise relations into symmetric and antisymmetric spectral components, allowing the model to capture high-frequency geometric details and direction-aware relations for precise spatial reasoning. Extensive experiments on ScanRefer, Nr3D and Sr3D validate the effectiveness of our method, demonstrating state-of-the-art performance with improvements of 2.05% Acc@0.25 for 3DREC and 1.09% mIoU for 3DRES on ScanRefer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fc5c473e-1e4b-49dd-97ea-b9d588f47168Builds on27
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- AdaptFormer: Adapting Vision Transformers for Scalable Visual RecognitionShoufa Chen, Chongjian Ge, Zhan Tong, Jiangliu Wang et al.NeurIPS 2022 · 1,291 citations
- Scaling & Shifting Your Features: A New Baseline for Efficient Model TuningDongze Lian, Daquan Zhou, Jiashi Feng, Xinchao WangNeurIPS 2022 · 415 citations
- 3D-VisTA: Pre-trained Transformer for 3D Vision and Text AlignmentZiyu Zhu, Xiaojian Ma, Yixin Chen, Zhidong Deng et al.ICCV 2023 · 247 citations
- 3DVG-Transformer: Relation Modeling for Visual Grounding on Point CloudsLichen Zhao, Daigang Cai, Lu Sheng, Dong XuICCV 2021 · 234 citations
Related papers
- ORD: Object-Relation Decoupling for Generalized 3D Visual GroundingRonggang Huang, Fansen Meng, Huaidong Zhang, Xuemiao XuCVPR 2026
- TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual GroundingDailan He, Yusheng Zhao, Junyu Luo, Tianrui Hui et al.ACM MM 2021 · 81 citations
- AugRefer: Advancing 3D Visual Grounding via Cross-Modal Augmentation and Spatial Relation-based ReferringXinyi Wang, Na Zhao, Zhiyuan Han, Dan Guo et al.AAAI 2025 · 12 citations
- Multi-Attribute Interactions Matter for 3D Visual GroundingCan Xu, Yuehui Han, Rui Xu, Le Hui et al.CVPR 2024 · 5 citations
- 3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive SelectionJunyu Luo, Jiahui Fu, Xianghao Kong, Chen Gao et al.CVPR 2022 · 72 citations
