Affinder: Expressing Concepts of Situations that Afford Activities using Context-Detectors
Ryan Louie, Darren Gergle, Haoqi Zhang
Abstract
Context-aware applications have the potential to act opportunistically to facilitate human experiences and activities, from reminding us of places to perform personal activities, to identifying coincidental moments to engage in digitally-mediated shared experiences. However, despite the availability of context-detectors and programming frameworks for defining how such applications should trigger, designers lack support for expressing their human concepts of a situation and the experiences and activities they afford (e.g., situations to toss a frisbee) when context-features are made available at the level of locations (e.g., parks). This paper introduces Affinder, a block-based programming environment that supports constructing concept expressions that effectively translate their conceptions of a situation into a machine representation using available context features. During pilot testing, we discovered three bridging challenges that arise when expressing situations that cannot be encoded directly by a single context-feature. To overcome these bridging challenges, Affinder provides designers (1) an unlimited vocabulary search for discovering features they may have forgotten; (2) prompts for reflecting and expanding their concepts of a situation and ideas for foraging for context-features; and (3) simulation and repair tools for identifying and resolving issues with the precision of concept expressions on real use-cases. In a comparison study, we found that Affinder’s core functions helped designers stretch their concepts of how to express a situation, find relevant context-features matching their concepts, and recognize when the concept expression operated differently than intended on real-world cases. These results show that Affinder and tools that support bridging can improve a designer’s ability to express their concepts of a human situation into detectable machine representations—thus pushing the boundaries of how computing systems support our activities in the world.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 38bb0d6d-ca41-46ef-b3d1-cf351d26901bCited by top-tier papers4
- From Gap to Synergy: Enhancing Contextual Understanding through Human-Machine Collaboration in Personalized SystemsWeihao Chen, Chun Yu, Huadong Wang, Zheng Wang et al.UIST 2023 · 28 citations
- Orchestration Scripts: A System for Encoding an Organization's Ways of Working to Support Situated WorkKapil Garg, Darren Gergle, Haoqi ZhangCHI 2023 · 7 citations
- TAO: Context Detection from Daily Activity Patterns Using Temporal Analysis and OntologySudershan Boovaraghavan, Prasoon Patidar, Yuvraj AgarwalUbiComp 2023 · 5 citations
- What We Talk About When We Talk About Frameworks in HCIShitao Fang, Koji Yatani, Kasper HornbækCHI 2026 · 4 citations
Related papers
- CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware ApplicationsTianyi Wang, Xun Qian, Fengming He, Xiyun Hu et al.UIST 2020 · 72 citations
- Opportunistic Collective Experiences: Identifying Shared Situations and Structuring Shared Activities at DistanceRyan Louie, Kapil Garg, Jennie Werner, Allison Sun et al.CSCW 2020 · 9 citations
- Scene-aware Human Pose Generation using TransformerJieteng Yao, Junjie Chen, Li Niu, Bin ShengACM MM 2023 · 43 citations
- Figaro: A Tabletop Authoring Environment for Human-Robot InteractionDavid J. Porfirio, Laura Stegner, Maya Cakmak, Allison Sauppé et al.CHI 2021 · 12 citations
- Cognitive Bridge: AI-Generated Boundary Objects for Cross-Functional CollaborationTamil Selvan Gunasekaran, Sophia Lim, Kunal Gupta, Huidong Bai et al.CHI 2026 · 1 citation
