EmBrace: A Collective Knowledge Fusion Framework Toward Unified EEG Foundation Models
Chenyu Liu, MUYUN JIANG, Pu Wan, Jinxin Pi, Jingying Ma, Peiliang Gong, Xinliang Zhou, Yi Ding, Chenyu Liu
摘要
Electroencephalography (EEG) foundation models (EFMs) have achieved strong performance across a wide range of downstream EEG tasks via pretraining and fine-tuning. Through empirical analysis, we observe that (i) no single EFM consistently dominates all tasks, yet identifying the task-specific optimal model by finetuning all EFMs introduces substantial computational overhead; and (ii) models with inferior task-level performance still exhibit strengths at the sample level as distinct architectures induce diverse inductive biases. These observations motivate EmBrace, a representation-centric framework for sample-aware knowledge fusion that avoids the constraints of parameter-level or output-level alignment. EmBrace synchronizes discriminative intermediate representations into a unified manifold and adaptively weights multiple EFMs at the sample level while selecting the most compatible model as the carrier. Extensive experiments across multiple EEG benchmarks demonstrate that EmBrace consistently improves over SOTA EFMs and generalizes effectively under cross-task settings. Our code is available at GitHub.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 被引用 3,482 次
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timeMitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs 等ICML 2022 · 被引用 1,464 次
- Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIWei-Bang Jiang, Li-Ming Zhao, Bao-Liang LuICLR 2024 · 被引用 298 次
- EEGPT: Pretrained Transformer for Universal and Reliable Representation of EEG SignalsGuangyu Wang, Wenchao Liu, Yuhong He, Cong Xu 等NeurIPS 2024 · 被引用 267 次
- Transferability and Hardness of Supervised Classification TasksAnh Tuan Tran, Cuong V. Nguyen, Tal HassnerICCV 2019 · 被引用 201 次
相关 Paper
- EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation ModelsWei Xiong, Jiangtong Li, Jie Li, Kun Zhu 等ICML 2026 · 被引用 15 次
- REVE: A Foundation Model for EEG - Adapting to Any Setup with Large-Scale Pretraining on 25, 000 SubjectsYassine El Ouahidi, Jonathan Lys, Philipp Thölke, Nicolas Farrugia 等NeurIPS 2025 · 被引用 106 次
- CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation ModelJingying Ma, Feng Wu, Qika Lin, Yucheng Xing 等ICLR 2026 · 被引用 25 次
- ECHO: Toward Contextual Seq2Seq Paradigms in Large EEG ModelsChenyu Liu, Yuqiu Deng, Tianyu Liu, Jinan Zhou 等ICLR 2026 · 被引用 12 次
- EEG-DLite: Dataset Distillation for Efficient Large EEG Model TrainingYuting Tang, Weibang Jiang, Shanglin Li, Yong Li 等AAAI 2026
