FloorPlan-LLaMa: Aligning Architects' Feedback and Domain Knowledge in Architectural Floor Plan Generation
Jun Yin, Pengyu Zeng, Haoyuan Sun, Yuqin Dai, Han Zheng, Miao Zhang, Yachao Zhang, Shuai Lu
Abstract
Floor plans serve as a graphical language through which architects sketch and communicate their design ideas. Actually, in the Architecture, Engineering, and Construction (AEC) design stages, generating floor plans is a complex task requiring domain expertise and alignment with user requirements. However, existing evaluation methods for floor plan generation rely mainly on statistical metrics like FID, GED, and PSNR, which often fail to evaluate using domain knowledge. As a result, even high-performing models on these metrics struggle to generate viable floor plans in practice. To address this, (1) we propose ArchiMet-ricsNet, the first floor plan dataset that includes functionality, flow, and overall evaluation scores, along with detailed textual analyses. We train FloorPlan-MPS (Multi-dimensional Preference Score) on it. (2) We develop FP-LLaMa, a floor plan generation model based on an autoregressive framework. To integrate architects' professional expertise and preferences, FloorPlan-MPS serves as the reward model during the RLHF (Reinforcement Learning from Human Feedback) process, thereby aligning FP-LLaMa with the needs of community. (3) Comparative experiments demonstrate that our method outperforms baseline models in both text-conditional and class-conditional tasks. Validation by professional architects confirms that our approach yields more rational plans and aligns better with their preferences.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- CARD: Cross-modal Agent Framework for Generative and Editable Residential DesignPengyu Zeng, Jun Yin, Miao Zhang, Yuqin Dai et al.EMNLP 2025 · 6 citations
- Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor PlansSizhong Qin, Ramon Elias Weber, Xinzheng LuCVPR 2026 · 1 citation
Builds on12
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- ImageReward: Learning and Evaluating Human Preferences for Text-to-Image GenerationJiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong et al.NeurIPS 2023 · 1,310 citations
- Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image GenerationYuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Matiana et al.NeurIPS 2023 · 1,192 citations
- Vector-quantized Image Modeling with Improved VQGANJiahui Yu, Xin Li, Jing Yu Koh, Han Zhang et al.ICLR 2022 · 753 citations
- MaskGIT: Masked Generative Image TransformerHuiwen Chang, Han Zhang, Lu Jiang, Ce Liu et al.CVPR 2022 · 346 citations
Related papers
- Unified Vector Floorplan Generation via Markup RepresentationKaede Shiohara, Toshihiko YamasakiCVPR 2026
- MRED-14: A Benchmark for Low-Energy Residential Floor Plan Generation with 14 Flexible InputsPengyu Zeng, Jun Yin, Haoyuan Sun, Yuqin Dai et al.ACM MM 2025 · 2 citations
- How to Evaluate Reward Models for RLHFEvan Frick, Tianle Li, Connor Chen, Wei-Lin Chiang et al.ICLR 2025
- Intelligent Home 3D: Automatic 3D-House Design From Linguistic Descriptions OnlyQi Chen, Qi Wu, Rui Tang, Yuhan Wang et al.CVPR 2020
- House-GAN++: Generative Adversarial Layout Refinement Network towards Intelligent Computational Agent for Professional ArchitectsNelson Nauata, Sepidehsadat Hosseini, Kai-Hung Chang, Hang Chu et al.CVPR 2021
