Cooperative Design Optimization through Natural Language Interaction

Figure 1: Concept of cooperative design optimization through natural language interaction. The user interface designer iteratively conducts user tests to discover the best design parameters (right side). During this process, the designer cooperates with our system, a Bayesian optimization (BO) system extended with a large language model (LLM), to decide the condition to test next (left side). The cooperation is done through natural language, offering the opportunity for flexible and cognitively easy intervention in the optimization process.