Subjective Camera 1.0: Bridging Human Cognition and Visual Reconstruction Through Sequence-Aware Sketch-Guided Diffusion
Haoyang Chen, Dongfang Sun, Caoyuan Ma, Shiqin Wang, Kewei Zhang, Zheng Wang, Zhixiang Wang
Abstract
We introduce the concept of a subjective camera to reconstruct meaningful moments that physical cameras fail to capture. We propose Subjective Camera 1.0, a framework for reconstructing real-world scenes from readily accessible subjective readouts, i.e., textual descriptions and progressively drawn rough sketches. Built on optimization-based alignment of diffusion models, our approach avoids large-scale paired training data and mitigates generalization issues. To address the challenge of integrating multiple abstract concepts in real-world scenarios, we design a Sequence-Aware Sketch-Guided Diffusion framework with three loss terms for concept-wise sequential optimization, following the natural order of subjective readouts. Experiments on two datasets demonstrate that our method achieves state-of-the-art performance in image quality as well as spatial and semantic alignment with target scenes. User studies with 40 participants further confirm that our approach is consistently preferred. Our project page is at: subjective-camera.github.io
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Any2Any: Unified Arbitrary Modality Translation for Remote SensingHaoyang Chen, Jing Zhang, Di Wang, Hebaixu Wang et al.ICML 2026 · 5 citations
- Heuristic Self-Paced Learning for Domain Adaptive Semantic Segmentation under Adverse ConditionsShiqin Wang, Haoyang Chen, Huaizhou Huang, Yinkan He et al.CVPR 2026 · 1 citation
- Cross-Category Subjectivity Generalization for Style-Adaptive Sketch Re-IDZechao Hu, Zhengwei Yang, Hao Li, Zheng Wang et al.ICCV 2025 · 1 citation
Builds on25
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray et al.ICML 2021 · 6,356 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
Related papers
- Dual Optimal Transport for Multi-Concept Composition: Structural Alignment and Texture Injection in Diffusion ModelsHao Fu, Tianyu Su, Meng Liu, Chenfang Yang et al.ICML 2026
- Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume GenerationDelin An, Chaoli WangCVPR 2026
- Director3D: Real-world Camera Trajectory and 3D Scene Generation from TextXinyang Li, Zhangyu Lai, Linning Xu, Yansong Qu et al.NeurIPS 2024 · 60 citations
- Zero-1-to-3: Zero-shot One Image to 3D ObjectRuoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov et al.ICCV 2023 · 1,662 citations
- RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and TextureLiangchen Song, Liangliang Cao, Hongyu Xu, Kai Kang et al.ACM MM 2023 · 35 citations
