TextGT: A Double-View Graph Transformer on Text for Aspect-Based Sentiment Analysis
Shuo Yin, Guoqiang Zhong
Abstract
Aspect-based sentiment analysis (ABSA) is aimed at predicting the sentiment polarities of the aspects included in a sentence instead of the whole sentence itself, and is a finegrained learning task compared to the conventional text classification. In recent years, on account of the ability to model the connectivity relationships between the words in one sentence, graph neural networks have been more and more popular to handle the natural language processing tasks, and meanwhile many works emerge for the ABSA task. However, most of the works utilizing graph convolution easily incur the over-smoothing problem, while graph Transformer for ABSA has not been explored yet. In addition, although some previous works are dedicated to using both GNN and Transformer to handle text, the methods of tightly combining graph view and sequence view of text is open to research. To address the above issues, we propose a double-view graph Transformer on text (TextGT) for ABSA. In TextGT, the procedure in graph view of text is handled by GNN layers, while Transformer layers deal with the sequence view, and these two processes are tightly coupled, alleviating the over-smoothing problem. Moreover, we propose an algorithm for implementing a kind of densely message passing graph convolution called TextGINConv, to employ edge features in graphs. Extensive experiments demonstrate the effectiveness of our TextGT over the state-of-the-art approaches, and vali-
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 84f0f70c-2308-40a3-872d-7d7030c4c8cdCited by top-tier papers6
- Dynamic Multi-granularity Attribution Network for Aspect-based Sentiment AnalysisYanjiang Chen, Kai Zhang, Feng Hu, Xianquan Wang et al.EMNLP 2024 · 5 citations
- Towards Pre-trained Graph Condensation via Optimal TransportYeyu Yan, Shuai Zheng, Wenjun Hui, Xiangkai Zhu et al.NeurIPS 2025 · 3 citations
- Induce, Align, Predict: Zero-Shot Stance Detection via Cognitive Inductive ReasoningBowen Zhang, Jun Ma, Fuqiang Niu, Li Dong et al.AAAI 2026 · 1 citation
- Multi-knowledge Enhanced Graph Neural Network for Multi-trait Essay ScoringShiman Zhao, Siyuan Liu, Zhiqi ShenAAAI 2026
- Single-Pass, Depth-Selective Reading for Multi-Aspect Sentiment AnalysisYan Xia, Zhuangzhuang Pan, Amirrudin Kamsin, Chee Seng ChanACL 2026
Builds on17
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Do Transformers Really Perform Badly for Graph Representation?Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng et al.NeurIPS 2021 · 1,632 citations
- Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological ViewDeli Chen, Yankai Lin, Wei Li, Peng Li et al.AAAI 2020 · 1,353 citations
- Recipe for a General, Powerful, Scalable Graph TransformerLadislav Rampásek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu et al.NeurIPS 2022 · 1,216 citations
- Principal Neighbourhood Aggregation for Graph NetsGabriele Corso, Luca Cavalleri, Dominique Beaini, Pietro Liò et al.NeurIPS 2020 · 914 citations
Related papers
- Dependency Graph Enhanced Dual-transformer Structure for Aspect-based Sentiment ClassificationHao Tang, Donghong Ji, Chenliang Li, Qiji ZhouACL 2020 · 332 citations
- S²GSL: Incorporating Segment to Syntactic Enhanced Graph Structure Learning for Aspect-based Sentiment AnalysisBingfeng Chen, Qihan Ouyang, Yongqi Luo, Boyan Xu et al.ACL 2024 · 9 citations
- Dual Graph Convolutional Networks for Aspect-based Sentiment AnalysisRuifan Li, Hao Chen, Fangxiang Feng, Zhanyu Ma et al.ACL 2021
- A Joint Training Dual-MRC Framework for Aspect Based Sentiment AnalysisYue Mao, Yi Shen, Chao Yu, Longjun CaiAAAI 2021 · 243 citations
- Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis ModelHongjiang Jing, Zuchao Li, Hai Zhao, Shu JiangEMNLP 2021 · 20 citations
