Lune

CHI2026Top-tier venue

Who Controls the Conversation? User Perspectives on Generative AI (LLM) System Prompts

Anna Neumann, Yulu Pi, Jatinder Singh

2026Year
3Citations
1Top-tier citations

Abstract

System prompts-instructions that shape the behaviour of generative AI systems-strongly influence system outputs and users' experiences. They define the model's guidelines, 'personality', and guardrails, taking precedence over user inputs. Despite their influence, transparency is limited: system prompts are generally not made public and most platforms instruct models to conceal them, leaving users disconnected from and unaware of a key mechanism guiding and governing their AI interactions.

This paper argues that system prompts warrant explicit, usercentred design attention and, focusing on large language models (LLMs), asks: what do system prompts contain, how do end-users perceive them, and what do these perceptions offer for design and governance practice?

Our results reveal user perspectives on: the benefits and risks of system prompts; the values they prefer to be associated with prompt-design; their levels of comfort with different types of prompts; and degrees of transparency and user control regarding prompt content. From these findings emerge considerations for how designers can better align system prompt mechanisms with user expectations and preferences over these mechanisms that directly shape how generative AI systems behave.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 77f09417-c071-45e1-b41f-82cfdd9a499d

Cited by top-tier papers1

Ask how each one uses it

Builds on37

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines