ACL Findings2026
TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation
Bangde Du, Minghao Guo, Songming He, Ziyi Ye, Xi Zhu, Weihang Su, Shuqi Zhu, Yujia Zhou, Yongfeng Zhang, Qingyao Ai, Yiqun Liu
摘要
Large Language Models (LLMs) are exhibiting emergent human-like abilities and are envisioned as the tool for simulating an individual's communication patterns, behaviors, and personality traits. However, current evaluations of LLM-based persona simulation remain limited: most rely on synthetic dialogues and lack finegrained analysis of the capability for persona simulation. To address these limitations, we introduce TwinVoice, a comprehensive benchmark for assessing persona simulation across diverse real-world contexts. TwinVoice encompasses three dimensions: Social Persona (public social interactions), Interpersonal Persona (private dialogues), and Narrative Persona (rolebased expression). It further decomposes the evaluation into six fundamental capabilities, including opinion consistency, memory recall, logical reasoning, lexical fidelity, persona tone, and syntactic style. Experimental results reveal that while advanced models achieve moderate * Equal contribution.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
引用它的顶会 Paper1
它引用的 Paper8
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris 等UIST 2023 · 1,882 次引用
- REST: Stress Testing Large Reasoning Models by Asking Multiple Problems at OnceZhuoshi Pan, Qizhi Pei, Yu Li, Zinan Tang 等ACL 2026 · 13 次引用
- How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain SimulationRui Li, Heming Xia, Xinfeng Yuan, Qingxiu Dong 等ACL Findings 2025 · 8 次引用
- Query Augmentation with Brain SignalsZiyi Ye, Jingtao Zhan, Qingyao Ai, Yiqun Liu 等ACM MM 2024 · 7 次引用
- CloneMem: Benchmarking Long-Term Memory for AI ClonesSen Hu, Zhiyu Zhang, Yuxiang Wei, Xueran Han 等ACL 2026 · 6 次引用
相关 Paper
- Two Tales of Persona in LLMs: A Survey of Role-Playing and PersonalizationYu-Min Tseng, Yu-Chao Huang, Teng-Yun Hsiao, Wei-Lin Chen 等EMNLP Findings 2024 · 87 次引用
- Modeling, Evaluating, and Embodying Personality in LLMs: A SurveyIago Alves Brito, Julia Soares Dollis, Fernanda Bufon Färber, Pedro Schindler Freire Brasil Ribeiro 等EMNLP Findings 2025 · 1 次引用
- LongMP-Bench: A Benchmark for Multimodal Persona Understanding in Long-Term DialoguesZhuoqun Li, Zhaopei Huang, Wenxuan Wang, Qin JinACL Findings 2026
- Persona-Augmented Benchmarking: Evaluating LLMs Across Diverse Writing StylesKimberly Le Truong, Riccardo Fogliato, Hoda Heidari, Steven WuEMNLP 2025 · 2 次引用
- The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMsPengrui Han, Rafal Kocielnik, Peiyang Song, Ramit Debnath 等ICML 2026 · 33 次引用
