Beyond Geometry: Artistic Disparity Synthesis for Immersive 2D-to-3D
Ping Chen, Zezhou Chen, Xingpeng Zhang, Yanlin Qian, Huan Hu, Xiang Liu, Zipeng Wang, Xin Wang, Zhaoxiang Liu, Kai Wang, Shiguo Lian
Abstract
Current 2D-to-3D conversion methods achieve geometric accuracy but are artistically deficient, failing to replicate the immersive and emotionally resonant experience of professional 3D cinema. This is because "geometric reconstruction" paradigms mistake deliberate artistic intent-such as strategic zero-plane shifts for "pop-out" effects and local depth sculpting-for data "noise" or ambiguity. This paper argues for a new paradigm: Artistic Disparity Synthesis, shifting the goal from physically accurate disparity estimation to artistically coherent disparity synthesis. We propose Art3D 1 , a preliminary framework exploring this paradigm. Art3D uses a dual-path architecture to decouple global depth parameters (macrointent) from local artistic effects (visual brushstrokes) and learns from professional 3D film data via indirect supervision. We also introduce a preliminary evaluation method to quantify cinematic alignment. Experiments show our approach demonstrates potential in replicating key local outof-screen effects and aligning with the global depth styles of cinematic 3D content, laying the groundwork for a new class of artistically-driven conversion tools.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on3
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao et al.NeurIPS 2024 · 2,305 citations
- Visual Comfort Aware-Reinforcement Learning for Depth Adjustment of Stereoscopic 3D ImagesHak Gu Kim, Minho Park, Sangmin Lee, Seongyeop Kim et al.AAAI 2021 · 11 citations
- Stereo Vision Conversion from Planar Videos Based on Temporal Multiplane ImagesShanding Diao, Yuan Chen, Yang Zhao, Wei Jia et al.AAAI 2024 · 1 citation
Related papers
- CP3: Customizable 3D Pop-Out Effect Creation for Immersive Content Using Multimodal ModelsZezhou Chen, Ping Chen, Huan Hu, Xiang Liu et al.ACM MM 2025
- Cinematic Behavior Transfer via NeRF-based Differentiable FilmingXuekun Jiang, Anyi Rao, Jingbo Wang, Dahua Lin et al.CVPR 2024
- Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D StrokesHao-Bin Duan, Miao Wang, Yan-Xun Li, Yong-Liang YangCVPR 2024
- PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style MappingJiafu Chen, Wei Xing, Jiakai Sun, Tianyi Chu et al.AAAI 2024 · 2 citations
- Elastic3D: Controllable Stereo Video Conversion with Guided Latent DecodingNando Metzger, Prune Truong, Goutam Bhat, Konrad Schindler et al.CVPR 2026 · 3 citations
