Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor Plans
Sizhong Qin, Ramon Elias Weber, Xinzheng Lu
Abstract
Architectural floor plan design demands joint reasoning over geometry, semantics, and spatial hierarchy, which remains a major challenge for current AI systems. Although recent diffusion and language models improve visual fidelity, they still struggle with coherent spatial reasoning and controllable generation. We present HouseMind, a multimodal large language model that unifies floor plan understanding, generation, and editing in one framework. We introduce discrete room-instance tokens to construct a unified vocabulary that bridges layouts and symbolic reasoning. With multimodal alignment and instruction tuning, the model synthesizes coherent, controllable layouts from text instructions. Experiments show how the framework achieves superior geometric validity and controllability while remaining efficient and locally deployable.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f04ec24e-1d2d-4e52-9246-01c38820b355Builds on10
- Graph2Plan: learning floorplan generation from layout graphsRuizhen Hu, Zeyu Huang, Yuhan Tang, Oliver van Kaick et al.SIGGRAPH 2020 · 263 citations
- WallPlan: synthesizing floorplans by learning to generate wall graphsJiahui Sun, Wenming Wu, Ligang Liu, Wenjie Min et al.SIGGRAPH 2022 · 48 citations
- Tell2Design: A Dataset for Language-Guided Floor Plan GenerationSicong Leng, Yang Zhou, Mohammed Haroon Dupty, Wee Sun Lee et al.ACL 2023 · 20 citations
- FloorPlan-LLaMa: Aligning Architects' Feedback and Domain Knowledge in Architectural Floor Plan GenerationJun Yin, Pengyu Zeng, Haoyuan Sun, Yuqin Dai et al.ACL 2025 · 11 citations
- MaskPLAN: Masked Generative Layout Planning from Partial InputHang Zhang, Anton Savov, Benjamin DillenburgerCVPR 2024 · 9 citations
Related papers
- Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial ReasoningXingjian Ran, Yixuan Li, Linning Xu, Mulin Yu et al.NeurIPS 2025 · 34 citations
- HouseTune: Two-Stage Floorplan Generation with LLM AssistanceZiyang Zong, Guanying Chen, Zhaohuan Zhan, Fengcheng Yu et al.AAAI 2026
- FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured RepresentationsFedor Rodionov, Abdelrahman Eldesokey, Michael Birsak, John Femiani et al.ICML 2026 · 14 citations
- CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-stepZheyuan Liu, Munan Ning, Qihui Zhang, Shuo Yang et al.NeurIPS 2025 · 9 citations
- Co-Layout: LLM-driven Co-optimization for Interior LayoutChucheng Xiang, Ruchao Bao, Biyin Feng, Wenzheng Wu et al.AAAI 2026
