Error Diversity Matters: An Error-Resistant Ensemble Method for Unsupervised Dependency Parsing
Behzad Shayegh, Hobie H.-B. Lee, Xiaodan Zhu, Jackie Chi Kit Cheung, Lili Mou
Abstract
We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from low robustness against weak ensemble components due to error accumulation. To tackle this problem, we propose an efficient ensemble-selection approach that considers error diversity and avoids error accumulation. Results demonstrate that our approach outperforms each individual model as well as previous ensemble techniques. Additionally, our experiments show that the proposed ensemble-selection method significantly enhances the performance and robustness of our ensemble, surpassing previously proposed strategies, which have not accounted for error diversity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERTZhiyong Wu, Yun Chen, Ben Kao, Qun LiuACL 2020 · 158 citations
- Ensemble Distillation for Unsupervised Constituency ParsingBehzad Shayegh, Yanshuai Cao, Xiaodan Zhu, Jackie C. K. Cheung et al.ICLR 2024 · 10 citations
- EBBS: An Ensemble with Bi-Level Beam Search for Zero-Shot Machine TranslationYuqiao Wen, Behzad Shayegh, Chenyang Huang, Yanshuai Cao et al.AAAI 2025 · 8 citations
- Diversity Is Not All You Need: Training A Robust Cooperative Agent Needs Specialist PartnersRujikorn Charakorn, Poramate Manoonpong, Nat DilokthanakulNeurIPS 2024 · 3 citations
- An Equal-Size Hard EM Algorithm for Diverse Dialogue GenerationYuqiao Wen, Yongchang Hao, Yanshuai Cao, Lili MouICLR 2023 · 2 citations
Related papers
- Tree-Averaging Algorithms for Ensemble-Based Unsupervised Discontinuous Constituency ParsingBehzad Shayegh, Yuqiao Wen, Lili MouACL 2024
- Adapting Unsupervised Syntactic Parsing Methodology for Discourse Dependency ParsingLiwen Zhang, Ge Wang, Wenjuan Han, Kewei TuACL 2021
- Domain-Adapted Dependency Parsing for Cross-Domain Named Entity RecognitionChenxiao Dou, Xianghui Sun, Yaoshu Wang, Yunjie Ji et al.AAAI 2023 · 8 citations
- Efficient Diversity-Driven Ensemble for Deep Neural NetworksWentao Zhang, Jiawei Jiang, Yingxia Shao, Bin CuiICDE 2020 · 17 citations
- Evaluating and Enhancing the Robustness of Neural Network-based Dependency Parsing Models with Adversarial ExamplesXiaoqing Zheng, Jiehang Zeng, Yi Zhou, Cho-Jui Hsieh et al.ACL 2020 · 38 citations
