ACL Findings2022
Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis
Kai Zhang, Kun Zhang, Mengdi Zhang, Hongke Zhao, Qi Liu, Wei Wu, Enhong Chen
Abstract
Aspect-based sentiment analysis (ABSA) predicts sentiment polarity towards a specific aspect in the given sentence. While pre-trained language models such as BERT have achieved great success, incorporating dynamic semantic changes into ABSA remains challenging. To this end, in this paper, we propose to address this problem by Dynamic Re-weighting BERT (DR-BERT), a novel method designed to learn dynamic aspect-oriented semantics for ABSA. Specifically, we first take the Stack-BERT layers as a primary encoder to grasp the overall semantic of the sentence and then fine-tune it by incorporating a lightweight Dynamic Reweighting Adapter (DRA). Note that the DRA can pay close attention to a small region of the sentences at each step and re-weigh the vitally important words for better aspect-aware sentiment understanding. Finally, experimental results on three benchmark datasets demonstrate the effectiveness and the rationality of our proposed model and provide good interpretable insights for future semantic modeling.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
10 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Inducing Target-Specific Latent Structures for Aspect Sentiment Classification cites Relational Graph Attention Network for Aspect-based Sentiment Analysis
- Graph Adaptive Semantic Transfer for Cross-domain Sentiment Classification cites Relational Graph Attention Network for Aspect-based Sentiment Analysis
- DARE: Disentanglement-Augmented Rationale Extraction cites Graph Adaptive Semantic Transfer for Cross-domain Sentiment Classification
- Span-level Aspect-based Sentiment Analysis via Table Filling cites Inducing Target-Specific Latent Structures for Aspect Sentiment Classification
- Span-level Aspect-based Sentiment Analysis via Table Filling cites Relational Graph Attention Network for Aspect-based Sentiment Analysis
- Counterfactual-Enhanced Information Bottleneck for Aspect-Based Sentiment Analysis cites Relational Graph Attention Network for Aspect-based Sentiment Analysis
Cited by top-tier papers10
- DARE: Disentanglement-Augmented Rationale ExtractionLinan Yue, Qi Liu, Yichao Du, Yanqing An et al.NeurIPS 2022 · 24 citations
- Span-level Aspect-based Sentiment Analysis via Table FillingMao Zhang, Yongxin Zhu, Zhen Liu, Zhimin Bao et al.ACL 2023 · 21 citations
- Graph Adaptive Semantic Transfer for Cross-domain Sentiment ClassificationKai Zhang, Qi Liu, Zhenya Huang, Mingyue Cheng et al.SIGIR 2022 · 12 citations
- Counterfactual-Enhanced Information Bottleneck for Aspect-Based Sentiment AnalysisMingshan Chang, Min Yang, Qingshan Jiang, Ruifeng XuAAAI 2024 · 12 citations
- OneNet: A Fine-Tuning Free Framework for Few-Shot Entity Linking via Large Language Model PromptingXukai Liu, Ye Liu, Kai Zhang, Kehang Wang et al.EMNLP 2024 · 7 citations
Builds on6
- Relational Graph Attention Network for Aspect-based Sentiment AnalysisKai Wang, Weizhou Shen, Yunyi Yang, Xiaojun Quan et al.ACL 2020 · 614 citations
- Dependency Graph Enhanced Dual-transformer Structure for Aspect-based Sentiment ClassificationHao Tang, Donghong Ji, Chenliang Li, Qiji ZhouACL 2020 · 332 citations
- Inducing Target-Specific Latent Structures for Aspect Sentiment ClassificationChenhua Chen, Zhiyang Teng, Yue ZhangEMNLP 2020 · 131 citations
- Human Attention Maps for Text Classification: Do Humans and Neural Networks Focus on the Same Words?Cansu Sen, Thomas Hartvigsen, Biao Yin, Xiangnan Kong et al.ACL 2020 · 56 citations
- Replicate, Walk, and Stop on Syntax: An Effective Neural Network Model for Aspect-Level Sentiment ClassificationYaowei Zheng, Richong Zhang, Samuel Mensah, Yongyi MaoAAAI 2020 · 48 citations
Related papers
- Unified Feature and Instance Based Domain Adaptation for Aspect-Based Sentiment AnalysisChenggong Gong, Jianfei Yu, Rui XiaEMNLP 2020 · 66 citations
- Dynamic Multi-granularity Attribution Network for Aspect-based Sentiment AnalysisYanjiang Chen, Kai Zhang, Feng Hu, Xianquan Wang et al.EMNLP 2024 · 5 citations
- A Joint Training Dual-MRC Framework for Aspect Based Sentiment AnalysisYue Mao, Yi Shen, Chao Yu, Longjun CaiAAAI 2021 · 243 citations
- Improving Aspect-based Sentiment Analysis with Gated Graph Convolutional Networks and Syntax-based RegulationAmir Pouran Ben Veyseh, Nasim Nouri, Franck Dernoncourt, Quan Hung Tran et al.EMNLP Findings 2020 · 58 citations
- Target-Aspect-Sentiment Joint Detection for Aspect-Based Sentiment AnalysisHai Wan, Yufei Yang, Jianfeng Du, Yanan Liu et al.AAAI 2020 · 206 citations
