Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor Plans
Sizhong Qin, Ramon Elias Weber, Xinzheng Lu
摘要
Architectural floor plan design demands joint reasoning over geometry, semantics, and spatial hierarchy, which remains a major challenge for current AI systems. Although recent diffusion and language models improve visual fidelity, they still struggle with coherent spatial reasoning and controllable generation. We present HouseMind, a multimodal large language model that unifies floor plan understanding, generation, and editing in one framework. We introduce discrete room-instance tokens to construct a unified vocabulary that bridges layouts and symbolic reasoning. With multimodal alignment and instruction tuning, the model synthesizes coherent, controllable layouts from text instructions. Experiments show how the framework achieves superior geometric validity and controllability while remaining efficient and locally deployable.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Graph2Plan: learning floorplan generation from layout graphsRuizhen Hu, Zeyu Huang, Yuhan Tang, Oliver van Kaick 等SIGGRAPH 2020 · 被引用 263 次
- WallPlan: synthesizing floorplans by learning to generate wall graphsJiahui Sun, Wenming Wu, Ligang Liu, Wenjie Min 等SIGGRAPH 2022 · 被引用 48 次
- Tell2Design: A Dataset for Language-Guided Floor Plan GenerationSicong Leng, Yang Zhou, Mohammed Haroon Dupty, Wee Sun Lee 等ACL 2023 · 被引用 20 次
- FloorPlan-LLaMa: Aligning Architects' Feedback and Domain Knowledge in Architectural Floor Plan GenerationJun Yin, Pengyu Zeng, Haoyuan Sun, Yuqin Dai 等ACL 2025 · 被引用 11 次
- MaskPLAN: Masked Generative Layout Planning from Partial InputHang Zhang, Anton Savov, Benjamin DillenburgerCVPR 2024 · 被引用 9 次
相关 Paper
- Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial ReasoningXingjian Ran, Yixuan Li, Linning Xu, Mulin Yu 等NeurIPS 2025 · 被引用 34 次
- HouseTune: Two-Stage Floorplan Generation with LLM AssistanceZiyang Zong, Guanying Chen, Zhaohuan Zhan, Fengcheng Yu 等AAAI 2026
- FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured RepresentationsFedor Rodionov, Abdelrahman Eldesokey, Michael Birsak, John Femiani 等ICML 2026 · 被引用 14 次
- CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-stepZheyuan Liu, Munan Ning, Qihui Zhang, Shuo Yang 等NeurIPS 2025 · 被引用 9 次
- Co-Layout: LLM-driven Co-optimization for Interior LayoutChucheng Xiang, Ruchao Bao, Biyin Feng, Wenzheng Wu 等AAAI 2026
