Merge3D: Efficient 3D Multimodal LLMs via Joint 2D-3D Token Merging
Tianbo Pan, Xingyi Yang, Xinchao Wang
2026Year
Abstract
marks such as Scan2Cap, CV-Bench, and BLINK. Our code and checkpoints can be found at the project website https://tianbo-pan.github.io/merge3d/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1cc5c5f8-718f-465a-a1b1-4fdf7ce45919Builds on53
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Sigmoid Loss for Language Image Pre-TrainingXiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, Lucas BeyerICCV 2023 · 2,932 citations
- Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsPeter Tong, Ellis Brown, Penghao Wu, Sanghyun Woo et al.NeurIPS 2024 · 1,004 citations
- 3D-LLM: Injecting the 3D World into Large Language ModelsYining Hong, Haoyu Zhen, Peihao Chen, Shuhong Zheng et al.NeurIPS 2023 · 662 citations
- An Embodied Generalist Agent in 3D WorldJiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu et al.ICML 2024 · 361 citations
Related papers
- Semantic Scene Completion via Integrating Instances and Scene In-the-LoopYingjie Cai, Xuesong Chen, Chao Zhang, Kwan-Yee Lin et al.CVPR 2021
- Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse ExplorationZilong Huang, Jun He, Junyan Ye, Lihan Jiang et al.CVPR 2025
- Free360: Layered Gaussian Splatting for Unbounded 360-Degree View Synthesis from Extremely Sparse and Unposed ViewsChong Bao, Xiyu Zhang, Zehao Yu, Jiale Shi et al.CVPR 2025
- GaVS: 3D-Grounded Video Stabilization via Temporally-Consistent Local Reconstruction and RenderingZinuo You, Stamatios Georgoulis, Anpei Chen, Siyu Tang et al.SIGGRAPH 2025 · 3 citations
- PanSplat: 4K Panorama Synthesis with Feed-Forward Gaussian SplattingCheng Zhang, Haofei Xu, Qianyi Wu, Camilo Cruz Gambardella et al.CVPR 2025
