Maia-2: A Unified Model for Human-AI Alignment in Chess
Zhenwei Tang, Difan Jiao, Reid McIlroy-Young, Jon M. Kleinberg, Siddhartha Sen, Ashton Anderson
摘要
There are an increasing number of domains in which artificial intelligence (AI) systems both surpass human ability and accurately model human behavior. This introduces the possibility of algorithmically-informed teaching in these domains through more relatable AI partners and deeper insights into human decision-making. Critical to achieving this goal, however, is coherently modeling human behavior at various skill levels. Chess is an ideal model system for conducting research into this kind of human-AI alignment, with its rich history as a pivotal testbed for AI research, mature superhuman AI systems like AlphaZero, and precise measurements of skill via chess rating systems. Previous work in modeling human decision-making in chess uses completely independent models to capture human style at different skill levels, meaning they lack coherence in their ability to adapt to the full spectrum of human improvement and are ultimately limited in their effectiveness as AI partners and teaching tools. In this work, we propose a unified modeling approach for human-AI alignment in chess that coherently captures human style across different skill levels and directly captures how people improve. Recognizing the complex, non-linear nature of human learning, we introduce a skill-aware attention mechanism to dynamically integrate players' strengths with encoded chess positions, enabling our model to be sensitive to evolving player skill. Our experimental results demonstrate that this unified framework significantly enhances the alignment between AI and human players across a diverse range of expertise levels, paving the way for deeper insights into human decision-making and AI-guided teaching tools.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper7
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 被引用 64,255 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo 等NeurIPS 2022 · 被引用 8,168 次
- Aligning Superhuman AI with Human Behavior: Chess as a Model SystemReid McIlroy-Young, Siddhartha Sen, Jon M. Kleinberg, Ashton AndersonKDD 2020 · 被引用 77 次
- Modeling Strong and Human-Like Gameplay with KL-Regularized SearchAthul Paul Jacob, David J. Wu, Gabriele Farina, Adam Lerer 等ICML 2022 · 被引用 69 次
相关 Paper
- Learning Models of Individual Behavior in ChessReid McIlroy-Young, Russell Wang, Siddhartha Sen, Jon M. Kleinberg 等KDD 2022 · 被引用 17 次
- Designing Skill-Compatible AI: Methodologies and Frameworks in ChessKarim Hamade, Reid McIlroy-Young, Siddhartha Sen, Jon M. Kleinberg 等ICLR 2024 · 被引用 12 次
- Human-Aligned Chess With a Bit of SearchYiming Zhang, Athul Paul Jacob, Vivian Lai, Daniel Fried 等ICLR 2025 · 被引用 1 次
- Language Models as Implicit Tree SearchZiliang Chen, Zhao-Rong Lai, Yufeng Yang, Liangda Fang 等ICML 2025
- Enhancing Chess Reinforcement Learning with Graph RepresentationTomas Rigaux, Hisashi KashimaNeurIPS 2024 · 被引用 5 次
