CARD: Cross-modal Agent Framework for Generative and Editable Residential Design

In recent years, architectural design automation has made significant progress, but the complexity of open-world environments continues to make residential design a challenging task, often requiring experienced architects to perform multiple iterations and human-computer interactions. Therefore, assisting ordinary users in navigating these complex environments to generate and edit residential design is crucial. In this paper, we present the CARD framework, which leverages a system of specialized crossmodal agents to adapt to complex open-world environments. The framework includes a pointbased cross-modal information representation (CMI-P) that encodes the geometry and spatial relationships of residential rooms, a crossmodal residential generation model, supported by our customized Text2FloorEdit model, that acts as the lead designer to create standardized floor plans, and an embedded expert knowledge base for evaluating whether the designs meet user requirements and residential codes, providing feedback accordingly. Finally, a 3D rendering module assists users in visualizing and understanding the layout. CARD enables cross-modal residential generation from freetext input, empowering users to adapt to complex environments without requiring specialized expertise.