CVPR2024
Interactive3D: Create What You Want by Interactive 3D Generation
Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, Tianfan Xue, Dan Xu
Abstract
Stretch to enlarge wings (c) Rigid Drag to swing wings (d) Local Semantic Editing for burning wings I. First Stage: Gaussian Splatting II. Second Stage: InstantNGP (e) Combine to dragon knight (f) Representation Converter (g) Interactive Hash Refinement "A Draven Knight" "A red fire dragon" Figure 1 . Interactive 3D Generation. The first stage involves using Gaussian ellipsoids for creating a base model where users can interact through different operations, such as deformable dragging to add features like wings, stretching to enlarge parts, rigid dragging to reposition elements, and local semantic editing to apply specific visual effects, e.g., making wings appear aflame. The second stage shows the conversion of this proposed Gaussian representation into an InstantNGP structure followed by an Interactive Hash Refinement process, allowing for further detailed enhancements. It demonstrates the framework's capability to merge and refine complex generations.