Lune

EMNLP Findings2023

Synthesize, if you do not have: Effective Synthetic Dataset Creation Strategies for Self-Supervised Opinion Summarization in E-commerce

Tejpalsingh Siledar, Suman Banerjee, Amey Patil, Sudhanshu Singh, Muthusamy Chelliah, Nikesh Garera, Pushpak Bhattacharyya

Abstract

In e-commerce, opinion summarization is the process of condensing the opinions presented in product reviews. However, the absence of large amounts of supervised datasets presents challenges in generating both aspect-specific and general opinion summaries. Existing approaches have attempted to address these challenges through synthetic dataset creation (SDC). However, general opinion summarization models struggle to generate summaries faithful to the input reviews whereas aspectspecific opinion summarization models are limited due to their reliance on human-specified aspects and seed words. To address this, we propose SDC strategies tailored for general and aspect-specific opinion summarization. We experimented on three e-commerce test sets: Oposum+, Amazon, and Flipkart. For general opinion summarization, pre-trained language model (PLM) fine-tuned on our general synthetic dataset surpass the SOTA on average by 2.3 R1 points. Faithfulness evaluation metrics and human evaluations indicate that our modelgenerated summaries are more faithful to the input compared to others. For aspect-specific opinion summarization, PLM fine-tuned on our aspect-specific synthetic dataset surpass SOTA by ∼ 1 R1 point without the aid of any humanspecified aspects or seed words.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. One Prompt To Rule Them All: LLMs for Opinion Summary EvaluationTejpalsingh Siledar, Swaroop Nath, Sankara Sri Raghava Ravindra Muddu, Rupasai Rangaraju et al.ACL 2024

Builds on10

  1. Evaluating the Factual Consistency of Abstractive Text SummarizationWojciech Kryscinski, Bryan McCann, Caiming Xiong, Richard SocherEMNLP 2020 · 67 citations
  2. Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language GenerationMingkai Deng, Bowen Tan, Zhengzhong Liu, Eric P. Xing et al.EMNLP 2021 · 49 citations
  3. Convex Aggregation for Opinion SummarizationHayate Iso, Xiaolan Wang, Yoshihiko Suhara, Stefanos Angelidis et al.EMNLP Findings 2021 · 29 citations
  4. TransSum: Translating Aspect and Sentiment Embeddings for Self-Supervised Opinion SummarizationKe Wang, Xiaojun WanACL Findings 2021 · 24 citations
  5. Unsupervised Opinion Summarization as Copycat-Review GenerationArthur Brazinskas, Mirella Lapata, Ivan TitovACL 2020 · 14 citations

Related papers

  1. Unsupervised Opinion Summarization with Content PlanningReinald Kim Amplayo, Stefanos Angelidis, Mirella LapataAAAI 2021 · 51 citations
  2. Unsupervised Opinion Summarization with Noising and DenoisingReinald Kim Amplayo, Mirella LapataACL 2020 · 8 citations
  3. Aspect-Controllable Opinion SummarizationReinald Kim Amplayo, Stefanos Angelidis, Mirella LapataEMNLP 2021
  4. Prompted Opinion Summarization with GPT-3.5Adithya Bhaskar, Alexander R. Fabbri, Greg DurrettACL Findings 2023 · 51 citations
  5. Few-Shot Learning for Opinion SummarizationArthur Brazinskas, Mirella Lapata, Ivan TitovEMNLP 2020 · 4 citations
Dusk over the sea between two cliffs drawn in fine vertical lines