Scaling Context-Aware Task Assistants that Learn from Demonstration and Adapt through Mixed-Initiative Dialogue
Riku Arakawa, Prasoon Patidar, Will Page, Jill Lehman, Mayank Goel
2025Year
3Citations
3Top-tier citations
Abstract
What's next? If you have attached the filter, adjust the grind level.
If you are brewing co ee, dump the co ee grinds next.
Oh, sure.
What are you doing? I'm pouring milk. Thanks for letting me know.
I'm washing the jar. Nice, the next step is to clean the wand.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- State Your Intention to Steer Your Attention: An AI Assistant for Intentional Digital LivingJuheon Choi, Juyong Lee, Jian Kim, Chanyoung Kim et al.CHI 2026 · 1 citation
- OrganicHAR: Towards Activity Discovery in Organic Settings for Privacy Preserving Sensors Using Efficient Video AnalysisPrasoon Patidar, Riku Arakawa, Ricardo Graça, Ruben Moutinho et al.UbiComp 2026
- Pro 2 Assist: Continuous Step-aware Proactive Assistance with Multi-modal Egocentric Perception for Long-horizon Procedural TasksLilin Xu, Bufang Yang, Siyang Jiang, Kaiwei Liu et al.UbiComp 2026
Builds on21
- Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM PromptsJ. D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, Qian YangCHI 2023 · 892 citations
- HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real WorldXin Wang, Taein Kwon, Mahdi Rad, Bowen Pan et al.ICCV 2023 · 151 citations
- Do Users Write More Insecure Code with AI Assistants?Neil Perry, Megha Srivastava, Deepak Kumar, Dan BonehCCS 2023 · 150 citations
- Vid2Doppler: Synthesizing Doppler Radar Data from Videos for Training Privacy-Preserving Activity RecognitionKaran Ahuja, Yue Jiang, Mayank Goel, Chris HarrisonCHI 2021 · 118 citations
- Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction TechniquesLiwei Chan, Yi-Chi Liao, George B. Mo, John J. Dudley et al.CHI 2022 · 94 citations
Related papers
- Brewing Under Pressure: More Realistic Tor Flow Correlation Considering Low FPRsHaeseung Jeon, Yeonseo Cho, Nate Mathews, Rob Jansen et al.CCS 2026
- Scrappy: Using Scrap Material as Infill to Make Fabrication More SustainableLudwig Wilhelm Wall, Alec Jacobson, Daniel Vogel, Oliver S. SchneiderCHI 2021 · 47 citations
- PAMotion: Physics-Aware Motion Generation for Full-Body Interaction with Multiple ObjectsYan Di, Yuheng Li, Yaoxing Wang, Mengge Liu et al.CVPR 2026
- EditDuet: A Multi-Agent System for Video Non-Linear EditingMarcelo Sandoval-Castañeda, Bryan C. Russell, Josef Sivic, Gregory Shakhnarovich et al.SIGGRAPH 2025 · 6 citations
- Ode to an ODEKrzysztof Marcin Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song et al.NeurIPS 2020
