Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgment
Leon Fröhling, Alessandro Giaconia, Edyta Paulina Bogucka, Daniele Quercia
Abstract
AI impact assessments often stress near-term risks because human judgment degrades over longer horizons, exemplifying the Collingridge dilemma: foresight is most needed when knowledge is scarcest. To address long-term systemic risks, we introduce a scalable approach that simulates in-silico agents using the foresight method of the Futures Wheel. We applied it to four AI uses spanning Technology Readiness Levels (TRLs): Chatbot Companion (TRL 9), AI Toy (TRL 7), Griefbot (TRL 5), and Death App (TRL 2). Across 30 agent runs per use, agents produced 86–110 consequences, condensed into 27–47 unique risks. To benchmark the agent outputs against human perspectives, we collected evaluations from 290 domain experts and 7 leaders, and conducted Futures Wheel sessions with 42 experts and 42 laypeople. Agents generated many systemic consequences. Compared with these outputs, experts identified fewer risks, typically less systemic but judged more likely, whereas laypeople surfaced more emotionally salient concerns that were generally less systemic. We propose a hybrid foresight workflow, wherein agents broaden systemic coverage, and humans provide contextual grounding.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ec7a0dac-b2e6-4f71-87d1-6a17444745e3Builds on12
- The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI RelationshipsRenwen Zhang, Han Li, Han Meng, Jinyuan Zhan et al.CHI 2025 · 122 citations
- CharacterMeet: Supporting Creative Writers' Entire Story Character Construction Processes Through Conversation with LLM-Powered Chatbot AvatarsHua Xuan Qin, Shan Jin, Ze Gao, Mingming Fan et al.CHI 2024 · 79 citations
- Farsight: Fostering Responsible AI Awareness During AI Application PrototypingZijie J. Wang, Chinmay Kulkarni, Lauren Wilcox, Michael Terry et al.CHI 2024 · 55 citations
- Guidelines for Integrating Value Sensitive Design in Responsible AI ToolkitsMalak Sadek, Marios Constantinides, Daniele Quercia, Céline MougenotCHI 2024 · 49 citations
- Let's Talk Futures: A Literature Review of HCI's Future OrientationCamilo Sanchez, Sui Wang, Kaisa Savolainen, Felix Anand Epp et al.CHI 2025 · 30 citations
Related papers
- Principles of Safe AI Companions for Youth: Parent and Expert PerspectivesYaman Yu, Mohi, Aishi Debroy, Xin Cao et al.CHI 2026 · 3 citations
- Persona-Grounded Safety Evaluation of AI Companions in Multi-Turn ConversationsPrerna Juneja, Lika LomidzeACL 2026
- WorkAI: A Toolkit for the Design of AI-driven Future of WorkShadan Sadeghian, Migle Bareikyte, Marcus Burkhardt, Marc HassenzahlCSCW 2025 · 6 citations
- Understanding Public Agencies' Expectations and Realities of AI-Driven Chatbots for Public Health MonitoringEunkyung Jo, Young-Ho Kim, Sang-Houn Ok, Daniel A. EpsteinCHI 2025 · 11 citations
- Branching Foresight - A Novel Interaction Concept for AI-generated Scenario ExplorationJakob Carl Uhl, Marita Huber, Aysenur Gurel, Sophie Westfahl et al.CHI 2026 · 1 citation
