FloorPlan-LLaMa: Aligning Architects' Feedback and Domain Knowledge in Architectural Floor Plan Generation
Jun Yin, Pengyu Zeng, Haoyuan Sun, Yuqin Dai, Han Zheng, Miao Zhang, Yachao Zhang, Shuai Lu
摘要
Floor plans serve as a graphical language through which architects sketch and communicate their design ideas. Actually, in the Architecture, Engineering, and Construction (AEC) design stages, generating floor plans is a complex task requiring domain expertise and alignment with user requirements. However, existing evaluation methods for floor plan generation rely mainly on statistical metrics like FID, GED, and PSNR, which often fail to evaluate using domain knowledge. As a result, even high-performing models on these metrics struggle to generate viable floor plans in practice. To address this, (1) we propose ArchiMet-ricsNet, the first floor plan dataset that includes functionality, flow, and overall evaluation scores, along with detailed textual analyses. We train FloorPlan-MPS (Multi-dimensional Preference Score) on it. (2) We develop FP-LLaMa, a floor plan generation model based on an autoregressive framework. To integrate architects' professional expertise and preferences, FloorPlan-MPS serves as the reward model during the RLHF (Reinforcement Learning from Human Feedback) process, thereby aligning FP-LLaMa with the needs of community. (3) Comparative experiments demonstrate that our method outperforms baseline models in both text-conditional and class-conditional tasks. Validation by professional architects confirms that our approach yields more rational plans and aligns better with their preferences.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- CARD: Cross-modal Agent Framework for Generative and Editable Residential DesignPengyu Zeng, Jun Yin, Miao Zhang, Yuqin Dai 等EMNLP 2025 · 被引用 6 次
- Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor PlansSizhong Qin, Ramon Elias Weber, Xinzheng LuCVPR 2026 · 被引用 1 次
它引用的顶会 Paper12
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- ImageReward: Learning and Evaluating Human Preferences for Text-to-Image GenerationJiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong 等NeurIPS 2023 · 被引用 1,310 次
- Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image GenerationYuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Matiana 等NeurIPS 2023 · 被引用 1,192 次
- Vector-quantized Image Modeling with Improved VQGANJiahui Yu, Xin Li, Jing Yu Koh, Han Zhang 等ICLR 2022 · 被引用 753 次
- MaskGIT: Masked Generative Image TransformerHuiwen Chang, Han Zhang, Lu Jiang, Ce Liu 等CVPR 2022 · 被引用 346 次
相关 Paper
- Unified Vector Floorplan Generation via Markup RepresentationKaede Shiohara, Toshihiko YamasakiCVPR 2026
- MRED-14: A Benchmark for Low-Energy Residential Floor Plan Generation with 14 Flexible InputsPengyu Zeng, Jun Yin, Haoyuan Sun, Yuqin Dai 等ACM MM 2025 · 被引用 2 次
- How to Evaluate Reward Models for RLHFEvan Frick, Tianle Li, Connor Chen, Wei-Lin Chiang 等ICLR 2025
- Intelligent Home 3D: Automatic 3D-House Design From Linguistic Descriptions OnlyQi Chen, Qi Wu, Rui Tang, Yuhan Wang 等CVPR 2020
- House-GAN++: Generative Adversarial Layout Refinement Network towards Intelligent Computational Agent for Professional ArchitectsNelson Nauata, Sepidehsadat Hosseini, Kai-Hung Chang, Hang Chu 等CVPR 2021
