When Generative AI Is Intimate, Sexy, and Violent: Examining Not-Safe-For-Work (NSFW) Chatbots on FlowGPT
Xian Li, Yuanning Han, Di Liu, Pengcheng An, Shuo Niu
摘要
Content Warning: This paper contains sexually explicit and violent images and text. User-created chatbots powered by generative AI offer new ways to share and interact with Not-Safe-For-Work (NSFW) content. However, little is known about the characteristics of these GenAI-based chatbots and their user interactions. Drawing on the functional theory of NSFW on social media, this study analyzes 376 NSFW chatbots and 307 public conversation sessions on FlowGPT. Findings identify four chatbot types: roleplay characters, story generators, image generators, and do-anything-now bots. AI Characters portraying fantasy personas and enabling hangout-style interactions are most common, often using explicit avatar images to invite engagement. Sexual, violent, and insulting content appears in both user prompts and chatbot outputs, with some chatbots generating explicit material even when users do not create erotic prompts. In sum, the NSFW experience on FlowGPT can be understood as a combination of virtual intimacy, sexual delusion, violent thought expression, and unsafe content acquisition. We conclude with implications for chatbot design, creator support, user safety, and content moderation.
• Human-centered computing → Empirical studies in collaborative and social computing.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- What Makes a Dark Pattern... Dark?: Design Attributes, Normative Considerations, and Measurement MethodsArunesh Mathur, Mihir Kshirsagar, Jonathan R. MayerCHI 2021 · 被引用 327 次
- More Kawaii than a Real-Person Live Streamer: Understanding How the Otaku Community Engages with and Perceives Virtual YouTubersZhicong Lu, Chenxinran Shen, Jiannan Li, Hong Shen 等CHI 2021 · 被引用 135 次
- "Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language ModelsXinyue Shen, Zeyuan Chen, Michael Backes, Yun Shen 等CCS 2024 · 被引用 132 次
- Human-LLM Collaborative Annotation Through Effective Verification of LLM LabelsXinru Wang, Hannah Kim, Sajjadur Rahman, Kushan Mitra 等CHI 2024 · 被引用 127 次
- The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI RelationshipsRenwen Zhang, Han Li, Han Meng, Jinyuan Zhan 等CHI 2025 · 被引用 122 次
相关 Paper
- Caught in a Mafia Romance: How Users Explore Intimate Narratives with ChatbotsJulia B. Kieserman, Cat Mai, Sara Lignell, Lucy Qin 等CHI 2026 · 被引用 1 次
- The AI Genie Phenomenon and Three Types of AI Chatbot Addiction: Escapist Roleplays, Pseudosocial Companions, and Epistemic Rabbit HolesM. Karen Shen, Jessica Huang, Olivia Liang, Ig-Jae Kim 等CHI 2026 · 被引用 6 次
- "Chat, Should I Leave Him?" Risks, Rewards, and Roles for AI in Relationship AdviceEmily Tseng, Calvin A. LiangCHI 2026 · 被引用 2 次
- Interrogating AI: Characterizing Emergent Playful Interactions with ChatGPTMohammad Ronagh Nikghalb, Jinghui ChengCSCW 2025 · 被引用 12 次
- The Illusion of Empathy: How AI Chatbots Shape Conversation PerceptionTingting Liu, Salvatore Giorgi, Ankit Aich, Allison Lahnala 等AAAI 2025 · 被引用 31 次
