Artificial Impressions: Evaluating Large Language Model Behavior Through the Lens of Trait Impressions

We introduce and study artificial impressionspatterns in LLMs' internal representations of prompts that resemble human impressions and stereotypes based on language. We fit linear probes on generated prompts to predict impressions according to the two-dimensional Stereotype Content Model (SCM). Using these probes, we study the relationship between impressions and downstream model behavior as well as prompt features that may inform such impressions. We find that LLMs inconsistently report impressions when prompted, but also that impressions are more consistently linearly decodable from their hidden representations. Additionally, we show that artificial impressions of prompts are predictive of the quality and use of hedging in model responses. We also investigate how particular content, stylistic, and dialectal features in prompts impact LLM impressions. 1 discrimination. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 13541-13564,