Interactive3D: Create What You Want by Interactive 3D Generation
Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, Tianfan Xue, Dan Xu
Abstract
Stretch to enlarge wings (c) Rigid Drag to swing wings (d) Local Semantic Editing for burning wings I. First Stage: Gaussian Splatting II. Second Stage: InstantNGP (e) Combine to dragon knight (f) Representation Converter (g) Interactive Hash Refinement "A Draven Knight" "A red fire dragon" Figure 1 . Interactive 3D Generation. The first stage involves using Gaussian ellipsoids for creating a base model where users can interact through different operations, such as deformable dragging to add features like wings, stretching to enlarge parts, rigid dragging to reposition elements, and local semantic editing to apply specific visual effects, e.g., making wings appear aflame. The second stage shows the conversion of this proposed Gaussian representation into an InstantNGP structure followed by an Interactive Hash Refinement process, allowing for further detailed enhancements. It demonstrates the framework's capability to merge and refine complex generations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers11
- FullPart: Generating each 3D Part at Full ResolutionLihe Ding, Shaocong Dong, Yaokun Li, Chenjian Gao et al.ICLR 2026 · 17 citations
- TINKER: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene OptimizationCanyu Zhao, Xiaoman Li, Tianjian Feng, Zhiyue Zhao et al.ICLR 2026 · 9 citations
- Towards Scalable and Consistent 3D EditingRuihao Xia, Yang Tang, Pan ZhouICML 2026 · 8 citations
- ScanEdit: Hierarchically-Guided Functional 3D Scan EditingMohamed El Amine Boudjoghra, Ivan Laptev, Angela DaiICCV 2025 · 6 citations
- From One to More: Contextual Part Latents for 3D GenerationShaocong Dong, Lihe Ding, Xiao Chen, Yaokun Li et al.ICCV 2025 · 4 citations
Builds on23
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
Related papers
- ObjectMorpher: 3D-Aware Image Editing via Deformable 3DGSYuhuan Xie, Aoxuan Pan, Yihua Huang, Chirui Chang et al.CVPR 2026
- Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian SplattingYansong Qu, Dian Chen, Xinyang Li, Xiaofan Li et al.SIGGRAPH 2025 · 14 citations
- Hash3D: Training-free Acceleration for 3D GenerationXingyi Yang, Songhua Liu, Xinchao WangCVPR 2025
- 3DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D EditingJiahua Dong, Yu-Xiong WangICLR 2025
- Deformable Radial Kernel SplattingYi-Hua Huang, Ming-Xian Lin, Yang-Tian Sun, Ziyi Yang et al.CVPR 2025
