ROAMM: A Benchmark Dataset for Multimodal Human Attention Decoding and EEG-to-Text Modeling During Naturalistic Reading
Haorui Sun, Ardyn Olszko, Niharika Singh, David Jangraw
Abstract
We present Reading Observed At Mindless Moments (ROAMM), a multimodal dataset comprising 50 hours of simultaneous EEG and eye-tracking recordings collected during naturalistic multi-page reading from 44 participants. ROAMM includes synchronized physiological recordings, eye-movement events, page-level comprehension scores, and span-level mind-wandering (MW) annotations obtained using a retrospective self-report paradigm. We introduce a standardized leave-one-subject-out benchmark for MW detection and achieve up to 0.609 AUROC using supervised models. We additionally evaluate EEG-to-text decoding on reading segments with and without MW labels, showing that decoding performance decreases during MW episodes. ROAMM enables research on MW detection, EEG-to-text decoding, multimodal representation learning, and attention-related degradation of language representations during naturalistic reading.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4014ec92-c9ba-46dc-a6a8-0c085fdb19a7Builds on2
- Open Vocabulary Electroencephalography-to-Text Decoding and Zero-Shot Sentiment ClassificationZhenhailong Wang, Heng JiAAAI 2022 · 122 citations
- Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked AutoencoderJiaqi Wang, Zhenxi Song, Zhengyu Ma, Xipeng Qiu et al.ACL 2024
Related papers
- Fine-Grained Prediction of Reading Comprehension from Eye MovementsOmer Shubi, Yoav Meiri, Cfir Avraham Hadar, Yevgeni BerzakEMNLP 2024 · 6 citations
- A Multimodal EEG-Eye Movement Model for Automatic Depression DetectionHao-Long Yin, Jian-Ming Zhang, Ren-Jie Dai, Wei-Long Zheng et al.AAAI 2026
- Decoding Open-Ended Information Seeking Goals from Eye Movements in ReadingCfir Avraham Hadar, Omer Shubi, Yoav Meiri, Amit Heshes et al.ICLR 2026 · 2 citations
- Is EEG-to-Text Feasible in Real-World Scenarios? An In-Depth Analysis Using a Neuropsychology-Inspired BenchmarkZihan Zhang, Yu Bao, Xiao Ding, Tianyi Jiang et al.ACL 2026
- Reading Recognition in the WildCharig Yang, Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx et al.NeurIPS 2025 · 9 citations
