Learning Interpretable Style Embeddings via Prompting LLMs

Style representation learning builds contentindependent representations of author style in text. To date, no large dataset of texts with stylometric annotations on a wide range of style dimensions has been compiled, perhaps because the linguistic expertise to perform such annotation would be prohibitively expensive. Therefore, current style representation approaches make use of unsupervised neural methods to disentangle style from content to create style vectors. These approaches, however, result in uninterpretable representations, complicating their usage in downstream applications like authorship attribution where auditing and explainability is critical. In this work, we use prompting to perform stylometry on a large number of texts to generate a synthetic stylometry dataset. We use this synthetic data to then train humaninterpretable style representations we call LISA embeddings. We release our synthetic dataset (STYLEGENOME) and our interpretable style embedding model (LISA) as resources.

Generation: The author is using a conversational style of grammar. The author is using short, simple sentences. The author is using language that is informal and direct. The author is expressing enthusiasm for the topic in a straightforward manner. The author is using contractions, such as "I'll". The author is using a casual tone. The author is emphasizing their interest in the topic with the phrase "really cool". The author is using the present tense to express anticipation for the future. Type Dataset Style Attribute Spearman Correlation (ρ) Formality Formality in Online Communication The author uses informal language. 0.599 Grammarly's Yahoo Answers Formality Corpus 0.200 Sentiment Yelp Reviews The author uses a negative tone. 0.788 IMDB Large Movie Review Dataset 0.665 ...abbreviated for space, see Appendix F for full results Emotion DAIR.AI Emotion (Love vs. Anger) The author is expressing emotion. 0.542 DAIR.AI Emotion (Joy vs. Sad) 0.531 GoEmotions (Love vs. Anger) 0.769 GoEmotions (Joy vs. Sadness) 0.639 GoEmotions (Disgust vs. Desire) 0.630 ...abbreviated for space, see Appendix F for full results Author Profiling