"Because AI is 100% right and safe": User Attitudes and Sources of AI Authority in India
Shivani Kapania, Oliver Siy, Gabe Clapper, Azhagu Meena SP, Nithya Sambasivan
Abstract
Most prior work on human-AI interaction is set in communities that indicate skepticism towards AI, but we know less about contexts where AI is viewed as aspirational. We investigated the perceptions around AI systems by drawing upon 32 interviews and 459 survey respondents in India. Not only do Indian users accept AI decisions (79.2% respondents indicate acceptance), we find a case of AI authority—AI has a legitimized power to influence human actions, without requiring adequate evidence about the capabilities of the system. AI authority manifested into four user attitudes of vulnerability: faith, forgiveness, self-blame, and gratitude, pointing to higher tolerance for system misfires, and introducing potential for irreversible individual and societal harm. We urgently call for calibrating AI authority, reconsidering success metrics and responsible AI approaches and present methodological suggestions for research and deployments in India.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers26
- Co-Writing with Opinionated Language Models Affects Users' ViewsMaurice Jakesch, Advait Bhat, Daniel Buschek, Lior Zalmanson et al.CHI 2023 · 249 citations
- How Knowledge Workers Think Generative AI Will (Not) Transform Their IndustriesAllison Woodruff, Renee Shelby, Patrick Gage Kelley, Steven Rousso-Schindler et al.CHI 2024 · 109 citations
- Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI GuidebookNur Yildirim, Mahima Pushkarna, Nitesh Goyal, Martin Wattenberg et al.CHI 2023 · 103 citations
- Algorithmic Power or Punishment: Information Worker Perspectives on Passive Sensing Enabled AI Phenotyping of Performance and WellbeingVedant Das Swain, Lan Gao, William A. Wood, Srikruthi C. Matli et al.CHI 2023 · 42 citations
- Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision MakingZhuoran Lu, Dakuo Wang, Ming YinCSCW 2024 · 36 citations
Builds on9
- Questioning the AI: Informing Design Practices for Explainable AI User ExperiencesQ. Vera Liao, Daniel M. Gruen, Sarah MillerCHI 2020 · 758 citations
- "Everyone wants to do the model work, not the data work": Data Cascades in High-Stakes AINithya Sambasivan, Shivani Kapania, Hannah Highfill, Diana Akrong et al.CHI 2021 · 725 citations
- Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual DifferencesRuotong Wang, F. Maxwell Harper, Haiyi ZhuCHI 2020 · 209 citations
- Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic BehaviorsHong Shen, Alicia DeVos, Motahhare Eslami, Kenneth HolsteinCSCW 2021 · 156 citations
- Who Is Included in Human Perceptions of AI?: Trust and Perceived Fairness around Healthcare AI and Cultural MistrustMin Kyung Lee, Katherine RichCHI 2021 · 135 citations
Related papers
- Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision MakingSuzanne Tolmeijer, Markus Christen, Serhiy Kandul, Markus Kneer et al.CHI 2022 · 68 citations
- Responsibility Attribution in Human Interactions with Everyday AI SystemsJoe Brailsford, Frank Vetere, Eduardo VellosoCHI 2025 · 10 citations
- Owning Mistakes Sincerely: Strategies for Mitigating AI ErrorsAmama Mahmood, Jeanie W. Fung, Isabel Won, Chien-Ming HuangCHI 2022 · 50 citations
- "Are You Really Sure?" Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision MakingShuai Ma, Xinru Wang, Ying Lei, Chuhan Shi et al.CHI 2024 · 54 citations
- Why Don't People Follow Robot Leaders? Understanding the Effects of Power Legitimacy on Compliance with AgentsHuajie Jay Cao, Minrui Chen, Wei Peng, Hee Rin LeeCHI 2026 · 1 citation
