Privacy-Preserving Script Sharing in GUI-based Programming-by-Demonstration Systems
Toby Jia-Jun Li, Jingya Chen, Brandon Canfield, Brad A. Myers
Abstract
An important concern in end user development (EUD) is accidentally embedding personal information in program artifacts when sharing them. This issue is particularly important in GUI-based programming-bydemonstration (PBD) systems due to the lack of direct developer control of script contents. Prior studies reported that these privacy concerns were the main barrier to script sharing in EUD. We present a new approach that can identify and obfuscate the potential personal information in GUI-based PBD scripts based on the uniqueness of information entries with respect to the corresponding app GUI context. Compared with the prior approaches, ours supports broader types of personal information beyond explicitly pre-specified ones, requires minimal user effort, addresses the threat of re-identification attacks, and can work with third-party apps from any task domain. Our approach also recovers obfuscated fields locally on the script consumer's side to preserve the shared scripts' transparency, readability, robustness, and generalizability. Our evaluation shows that our approach (1) accurately identifies the potential personal information in scripts across different apps in diverse task domains; (2) allows end-user developers to feel comfortable sharing their own scripts; and (3) enables script consumers to understand the operation of shared scripts despite the obfuscated fields.
CCS Concepts: • Human-centered computing → Human computer interaction (HCI); Collaborative and social computing systems and tools; • Security and privacy → Usability in security and privacy; • Software and its engineering → Programming by example.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Screen2Vec: Semantic Embedding of GUI Screens and GUI ComponentsToby Jia-Jun Li, Lindsay Popowski, Tom M. Mitchell, Brad A. MyersCHI 2021 · 72 citations
- Exploring the Needs of Users for Supporting Privacy-Protective Behaviors in Smart HomesHaojian Jin, Boyuan Guo, Rituparna Roychoudhury, Yaxing Yao et al.CHI 2022 · 48 citations
- An Empathy-Based Sandbox Approach to Bridge the Privacy Gap among Attitudes, Goals, Knowledge, and BehaviorsChaoran Chen, Weijun Li, Wenxin Song, Yanfang Ye et al.CHI 2024 · 25 citations
- To Reuse or Not To Reuse?: A Framework and System for Evaluating Summarized KnowledgeMichael Xieyang Liu, Aniket Kittur, Brad A. MyersCSCW 2021 · 23 citations
- DroidRetriever: A Transparent and Steerable Automation System for Collaborative Mobile Information SeekingYiheng Bian, Yunpeng Song, Guiyu Ma, Rongrong Zhu et al.CHI 2026
Builds on1
Related papers
- UI Obfuscation and Its Effects on Automated UI Analysis for Android AppsHao Zhou, Ting Chen, Haoyu Wang, Le Yu et al.ASE 2020 · 9 citations
- AppBDS: LLM-Powered Description Synthesis for Sensitive Behaviors in Mobile AppsZichen Liu, Xusheng XiaoASE 2025
- Empowering IoT Developers with Privacy-Preserving End-User Development ToolsAtheer Aljeraisy, Omer F. Rana, Charith PereraUbiComp 2024 · 4 citations
- Only Pay for What You Leak: Leveraging Sandboxes for a Minimally Invasive Browser Fingerprinting DefenseRyan Torok, Amit LevyS&P 2023
- Least Privilege Access for Persistent Storage Mechanisms in Web BrowsersGayatri Priyadarsini Kancherla, Dishank Goel, Abhishek BichhawatWWW 2025 · 2 citations
