Lune

EMNLP Findings2023

Knowledge-Selective Pretraining for Attribute Value Extraction

Hui Liu, Qingyu Yin, Zhengyang Wang, Chenwei Zhang, Haoming Jiang, Yifan Gao, Zheng Li, Xian Li, Chao Zhang, Bing Yin, William Wang, Xiaodan Zhu

Abstract

Attribute Value Extraction (AVE) aims to retrieve the values of attributes from the product profiles. The state-of-the-art methods tackle the AVE task through a question-answering (QA) paradigm, where the value is predicted from the context (i.e. product profile) given a query (i.e. attributes). Despite of the substantial advancements that have been made, the performance of existing methods on rare attributes is still far from satisfaction, and they cannot be easily extended to unseen attributes due to the poor generalization ability. In this work, we propose to leverage pretraining and transfer learning to address the aforementioned weaknesses. We design a Knowledge-Selective Framework (KSelF) based on query expansion that can be closely combined with a pretraining corpus to boost the performance. Meanwhile, considering the public AE-pub dataset contains considerable noise, we construct a larger benchmark EC-AVE collected from E-commerce websites. We conduct evaluation on both of these datasets. The experimental results demonstrate that our proposed KSelF achieves new state-of-the-art performance without pretraining. When incorporated with the pretraining corpus, the performance of KSelF can be further improved, particularly on the attributes with limited training resources.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on10

  1. Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
  2. Autoregressive Entity RetrievalNicola De Cao, Gautier Izacard, Sebastian Riedel, Fabio PetroniICLR 2021 · 200 citations
  3. BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant SupervisionChen Liang, Yue Yu, Haoming Jiang, Siawpeng Er et al.KDD 2020 · 118 citations
  4. KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationWenhu Chen, Yu Su, Xifeng Yan, William Yang WangEMNLP 2020 · 115 citations
  5. Learning to Extract Attribute Value from Product via Question Answering: A Multi-task ApproachQifan Wang, Li Yang, Bhargav Kanagal, Sumit Sanghai et al.KDD 2020 · 75 citations

Related papers

  1. CoMave: Contrastive Pre-training with Multi-scale Masking for Attribute Value ExtractionXinnan Guo, Wentao Deng, Yongrui Chen, Yang Li et al.ACL Findings 2023 · 1 citation
  2. Pay Attention to Implicit Attribute Values: A Multi-modal Generative Framework for AVE TaskYupeng Zhang, Shensi Wang, Peiguang Li, Guanting Dong et al.ACL Findings 2023 · 9 citations
  3. OA-Mine: Open-World Attribute Mining for E-Commerce Products with Weak SupervisionXinyang Zhang, Chenwei Zhang, Xian Li, Xin Luna Dong et al.WWW 2022 · 36 citations
  4. AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive DecodingJun Yan, Nasser Zalmout, Yan Liang, Christan Grant et al.ACL 2021
  5. EAVE: Efficient Product Attribute Value Extraction via Lightweight Sparse-layer InteractionLi Yang, Qifan Wang, Jianfeng Chi, Jiahao Liu et al.EMNLP Findings 2024 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines