SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation
Sashuai zhou, Qiang Zhou, Ma Junpeng, Yue Cao, Ruofan Hu, Ziang Zhang, Xiaoda Yang, Zhibin Wang, Jun Song, Cheng Yu, Bo Zheng, Zhou Zhao
摘要
Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to fine-grained spatial relationships, often producing images that appear plausible overall yet contain inaccuracies in object positioning. In this work, we present SpatialReward, a verifiable reward model explicitly designed to evaluate spatial layouts in generated images. SpatialReward adopts a multi-stage pipeline: a Prompt Decomposer extracts entities, attributes, and spatial metadata from free-form prompts; expert detectors provide accurate visual grounding of object positions and attributes; and a vision-language model applies chain-of-thought reasoning over grounded observations to assess complex spatial relations that are challenging for rule-based methods. To more comprehensively evaluate spatial relationships in generated images, we introduce SpatRelBench, a benchmark covering object attributes, orientation, inter-object relations, and rendered text placement. Experiments on Stable Diffusion and FLUX show that incorporating SpatialReward into RL training consistently improves spatial consistency and overall generation quality, with results aligned more closely to human judgments. These findings indicate that verifiable reward models hold considerable potential for enabling more accurate and controllable optimization in text-to-image generation models.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- GIFT: Global Irreplaceability Frame Targeting for Efficient Video UnderstandingJunpeng Ma, Sashuai Zhou, Guanghao Li, Xin Gao 等CVPR 2026 · 被引用 7 次
- GeodesicNVS: Probability Density Geodesic Flow Matching for Novel View SynthesisXuqin Wang, Tao Wu, Yanfeng Zhang, Lu Liu 等CVPR 2026 · 被引用 4 次
- Hierarchical Codec Diffusion for Video-to-Speech GenerationJiaxin Ye, Gaoxiang Cong, Chenhui Wang, Xin-Cheng Wen 等CVPR 2026 · 被引用 3 次
- FontCrafter: High-Fidelity Element-Driven Artistic Font Creation with Visual In-Context GenerationWuyang Luo, Chengkaitan Chengkaitan to Chengkai Tan, Chang Ge, Binye Hong 等CVPR 2026 · 被引用 2 次
- Unified Thinker: A General Reasoning Core for Image GenerationSashuai Zhou, Qiang Zhou, Jijin Hu, Hanqing Yang 等ACL 2026
它引用的顶会 Paper39
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 等NeurIPS 2022 · 被引用 22,562 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray 等ICML 2021 · 被引用 6,356 次
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 被引用 3,620 次
相关 Paper
- Enhancing Spatial Understanding in Image Generation via Reward ModelingZhenyu Tang, Chaoran Feng, Yufan Deng, Jie Wu 等CVPR 2026 · 被引用 2 次
- Everything in Its Place: Benchmarking Spatial Intelligence of Text-to-Image ModelsZengbin Wang, Xuecai Hu, Yong Wang, Feng Xiong 等ICLR 2026 · 被引用 13 次
- GoT-R1: Unleashing Reasoning Capability of Autoregressive Visual Generation with Reinforcement LearningChengqi Duan, Rongyao Fang, Yuqing Wang, Kun Wang 等ICLR 2026 · 被引用 43 次
- SpatialReward: Bridging the Perception Gap in Online RL for Image Editing via Explicit Spatial ReasoningYancheng Long, Yankai Yang, Hongyang Wei, Wei Chen 等ICML 2026 · 被引用 6 次
- SpotActor: Training-Free Layout-Controlled Consistent Image GenerationJiahao Wang, Caixia Yan, Weizhan Zhang, Haonan Lin 等AAAI 2025 · 被引用 13 次
