ROAMM: A Benchmark Dataset for Multimodal Human Attention Decoding and EEG-to-Text Modeling During Naturalistic Reading
Haorui Sun, Ardyn Olszko, Niharika Singh, David Jangraw
摘要
We present Reading Observed At Mindless Moments (ROAMM), a multimodal dataset comprising 50 hours of simultaneous EEG and eye-tracking recordings collected during naturalistic multi-page reading from 44 participants. ROAMM includes synchronized physiological recordings, eye-movement events, page-level comprehension scores, and span-level mind-wandering (MW) annotations obtained using a retrospective self-report paradigm. We introduce a standardized leave-one-subject-out benchmark for MW detection and achieve up to 0.609 AUROC using supervised models. We additionally evaluate EEG-to-text decoding on reading segments with and without MW labels, showing that decoding performance decreases during MW episodes. ROAMM enables research on MW detection, EEG-to-text decoding, multimodal representation learning, and attention-related degradation of language representations during naturalistic reading.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper2
- Open Vocabulary Electroencephalography-to-Text Decoding and Zero-Shot Sentiment ClassificationZhenhailong Wang, Heng JiAAAI 2022 · 被引用 122 次
- Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked AutoencoderJiaqi Wang, Zhenxi Song, Zhengyu Ma, Xipeng Qiu 等ACL 2024
相关 Paper
- Fine-Grained Prediction of Reading Comprehension from Eye MovementsOmer Shubi, Yoav Meiri, Cfir Avraham Hadar, Yevgeni BerzakEMNLP 2024 · 被引用 6 次
- A Multimodal EEG-Eye Movement Model for Automatic Depression DetectionHao-Long Yin, Jian-Ming Zhang, Ren-Jie Dai, Wei-Long Zheng 等AAAI 2026
- Decoding Open-Ended Information Seeking Goals from Eye Movements in ReadingCfir Avraham Hadar, Omer Shubi, Yoav Meiri, Amit Heshes 等ICLR 2026 · 被引用 2 次
- Is EEG-to-Text Feasible in Real-World Scenarios? An In-Depth Analysis Using a Neuropsychology-Inspired BenchmarkZihan Zhang, Yu Bao, Xiao Ding, Tianyi Jiang 等ACL 2026
- Reading Recognition in the WildCharig Yang, Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx 等NeurIPS 2025 · 被引用 9 次
