Lune

EMNLP Findings2024

An Instruction Tuning-Based Contrastive Learning Framework for Aspect Sentiment Quad Prediction with Implicit Aspects and Opinions

Hao Zhang, Yu-N Cheah, Congqing He, Feifan Yi

Abstract

Aspect sentiment quad prediction (ASQP) is crucial in aspect-based sentiment analysis (ABSA). It involves identifying a text's aspect, sentiment, opinion, and category. Existing methods have insufficiently explored how to effectively leverage the knowledge of pre-trained language models (PLMs) to handle implicit aspects and opinions, particularly in combinations such as implicit aspect & explicit opinion, explicit aspect & implicit opinion, and implicit aspect & implicit opinion. We introduce ITSCL, a framework leveraging Instruction Tuning and Supervised Contrastive Learning to improve aspect sentiment quad predictions, especially for implicit aspects and opinions. Implementing this approach presents several challenges. First, designing effective instructions and prompts to optimize the model's training is difficult. Second, creating sentiment combination vectors with contrastive learning to enhance the model's discrimination requires further investigation. To address these challenges, ITSCL combines instruction tuning with aligned PLM templates, enabling better knowledge acquisition and identification of implicit sentiments. Additionally, the contrastive learning framework enhances performance by using four fully connected layers to combine sentiments, aspects, opinions, and combinations, maximizing similarity for same-label representations and minimizing it for different labels. Experimental results show our method significantly outperforms previous methods on benchmark datasets. 1

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on11

  1. Knowing What, How and Why: A Near Complete Solution for Aspect-Based Sentiment AnalysisHaiyun Peng, Lu Xu, Lidong Bing, Fei Huang et al.AAAI 2020 · 494 citations
  2. Position-Aware Tagging for Aspect Sentiment Triplet ExtractionLu Xu, Hao Li, Wei Lu, Lidong BingEMNLP 2020 · 264 citations
  3. A Joint Training Dual-MRC Framework for Aspect Based Sentiment AnalysisYue Mao, Yi Shen, Chao Yu, Longjun CaiAAAI 2021 · 243 citations
  4. Target-Aspect-Sentiment Joint Detection for Aspect-Based Sentiment AnalysisHai Wan, Yufei Yang, Jianfeng Du, Yanan Liu et al.AAAI 2020 · 206 citations
  5. SpanMlt: A Span-based Multi-Task Learning Framework for Pair-wise Aspect and Opinion Terms ExtractionHe Zhao, Longtao Huang, Rong Zhang, Quan Lu et al.ACL 2020 · 174 citations

Related papers

  1. Generative Aspect-Based Sentiment Analysis with Contrastive Learning and Expressive StructureJoseph Peper, Lu WangEMNLP Findings 2022 · 38 citations
  2. Aligning Black-Box LLMs for Aspect Sentiment Quad PredictionShichen Li, Jiawei Zhang, Zhongqing Wang, Peifeng LiEMNLP Findings 2025
  3. Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-TrainingZhengyan Li, Yicheng Zou, Chong Zhang, Qi Zhang et al.EMNLP 2021 · 101 citations
  4. Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad PredictionYice Zhang, Jie Zeng, Weiming Hu, Ziyi Wang et al.ACL 2024
  5. SimRP: Syntactic and Semantic Similarity Retrieval Prompting Enhances Aspect Sentiment Quad PredictionZhongquan Jian, Yanhao Chen, Jiajian Li, Shaopan Wang et al.AAAI 2025 · 5 citations
Dusk over the sea between two cliffs drawn in fine vertical lines