Marcelle: Composing Interactive Machine Learning Workflows and Interfaces
Jules Françoise, Baptiste Caramiaux, Téo Sanchez
Abstract
Human-centered approaches to machine learning have established theoretical foundations, design principles and interaction techniques to facilitate end-user interaction with machine learning systems. Yet, general-purpose toolkits supporting the design of interactive machine learning systems are still missing, despite their potential to foster reuse, appropriation and collaboration between different stakeholders including developers, machine learning experts, designers and end users. In this paper, we present an architectural model for toolkits dedicated to the design of human interactions with machine learning. The architecture is built upon a modular collection of interactive components that can be composed to build interactive machine learning workflows, using reactive pipelines and composable user interfaces. We introduce Marcelle, a toolkit for the design of human interactions with machine learning that implements this model. We illustrate Marcelle with two implemented case studies: (1) a HCI researcher conducts user studies to understand novice interaction with machine learning, and (2) a machine learning expert and a clinician collaborate to develop a skin cancer diagnosis system. Finally, we discuss our experience with the toolkit, along with its limitation and perspectives.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ffe8f2a0-0880-4341-a311-4e8976aa1aa7Cited by top-tier papers11
- Zeno: An Interactive Framework for Behavioral Evaluation of Machine LearningÁngel Alexander Cabrera, Erica Fu, Donald Bertucci, Kenneth Holstein et al.CHI 2023 · 51 citations
- Symphony: Composing Interactive Interfaces for Machine LearningAlex Bäuerle, Ángel Alexander Cabrera, Fred Hohman, Megan Maher et al.CHI 2022 · 47 citations
- Unveiling High-dimensional Backstage: A Survey for Reliable Visual Analytics with Dimensionality ReductionHyeon Jeon, Hyunwook Lee, Yun-Hsin Kuo, Taehyun Yang et al.CHI 2025 · 29 citations
- Model Sketching: Centering Concepts in Early-Stage Machine Learning Model DesignMichelle S. Lam, Zixian Ma, Anne Li, Izequiel Freitas et al.CHI 2023 · 25 citations
- Gesture-aware Interactive Machine Teaching with In-situ Object AnnotationsZhongyi Zhou, Koji YataniUIST 2022 · 20 citations
Builds on4
- Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to DesignQian Yang, Aaron Steinfeld, Carolyn P. Rosé, John ZimmermanCHI 2020 · 604 citations
- CNN Explainer: Learning Convolutional Neural Networks with Interactive VisualizationZijie J. Wang, Robert Turko, Omar Shaikh, Haekyu Park et al.IEEE VIS 2020 · 341 citations
- Understanding and Visualizing Data Iteration in Machine LearningFred Hohman, Kanit Wongsuphasawat, Mary Beth Kery, Kayur PatelCHI 2020 · 114 citations
- How do People Train a Machine?: Strategies and (Mis)UnderstandingsTéo Sanchez, Baptiste Caramiaux, Jules Françoise, Frédéric Bevilacqua et al.CSCW 2021 · 15 citations
Related papers
- A study of UX practitioners roles in designing real-world, enterprise ML systemsSabah Zdanowska, Alex S. TaylorCHI 2022 · 38 citations
- Computational Notebooks as Co-Design Tools: Engaging Young Adults Living with Diabetes, Family Carers, and Clinicians with Machine Learning ModelsAmid Ayobi, Jacob Hughes, Christopher J. Duckworth, Jakub J. Dylag et al.CHI 2023 · 26 citations
- Whither AutoML? Understanding the Role of Automation in Machine Learning WorkflowsDoris Xin, Eva Yiwei Wu, Doris Jung Lin Lee, Niloufar Salehi et al.CHI 2021 · 103 citations
- Towards Fairness in Practice: A Practitioner-Oriented Rubric for Evaluating Fair ML ToolkitsBrianna Richardson, Jean Garcia-Gathright, Samuel F. Way, Jennifer Thom et al.CHI 2021 · 56 citations
- Establishing Heuristics for Improving the Usability of GUI Machine Learning Tools for Novice UsersAsma Z. Yamani, Haifa Abdullah Al-Shammare, Malak BaslymanCHI 2024 · 3 citations
