Lune

ACL Findings2024

Real World Conversational Entity Linking Requires More Than Zero-Shots

Mohanna Hoveyda, Arjen P. de Vries, Faegheh Hasibi, Maarten de Rijke

摘要

Entity linking (EL) in conversations faces notable challenges in practical applications, primarily due to the scarcity of entity-annotated conversational datasets and sparse knowledge bases (KB) containing domain-specific, longtail entities. We designed targeted evaluation scenarios to measure the efficacy of EL models under resource constraints. Our evaluation employs two KBs: Fandom, exemplifying realworld EL complexities, and the widely used Wikipedia. First, we assess EL models' ability to generalize to a new unfamiliar KB using Fandom and a novel zero-shot conversational entity linking dataset that we curated based on Reddit discussions on Fandom entities. We then evaluate the adaptability of EL models to conversational settings without prior training.

Our results indicate that current zero-shot EL models falter when introduced to new, domainspecific KBs without prior training, significantly dropping in performance. Our findings reveal that previous evaluation approaches fall short of capturing real-world complexities for zero-shot EL, highlighting the necessity for new approaches to design and assess conversational EL models to adapt to limited resources. The evaluation setup and the dataset proposed in this research are made publicly available. 1

问 Lune

几分钟读透这篇 Paper,不用再花一下午。

Lune 能读完全文,也能读引用它的顶会 Paper,讲清它的结论、证据和局限,每一点都注明出自哪篇 Paper。不用硬啃,也不靠猜。

可以从这些问题问起

Lune 可以查阅

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

脉络

  • Autoregressive Entity Retrieval 引用了 Scalable Zero-shot Entity Linking with Dense Entity Retrieval
  • Entity-aware Transformers for Entity Search 引用了 Autoregressive Entity Retrieval
  • Large Language Models Struggle to Learn Long-Tail Knowledge 引用了 Autoregressive Entity Retrieval
它引用的引用它的从左到右按年份排列,引用越多,位置越高。

它引用的 Paper6

  1. Large Language Models Struggle to Learn Long-Tail KnowledgeNikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace 等ICML 2023 · 623 次引用
  2. Scalable Zero-shot Entity Linking with Dense Entity RetrievalLedell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel 等EMNLP 2020 · 336 次引用
  3. Autoregressive Entity RetrievalNicola De Cao, Gautier Izacard, Sebastian Riedel, Fabio PetroniICLR 2021 · 200 次引用
  4. Entity-aware Transformers for Entity SearchEmma J. Gerritse, Faegheh Hasibi, Arjen P. de VriesSIGIR 2022 · 27 次引用
  5. BERT-ER: Query-specific BERT Entity Representations for Entity RankingShubham Chatterjee, Laura DietzSIGIR 2022 · 18 次引用

相关 Paper

  1. Learn to Not Link: Exploring NIL Prediction in Entity LinkingFangwei Zhu, Jifan Yu, Hailong Jin, Lei Hou 等ACL Findings 2023 · 6 次引用
  2. Design Challenges in Low-resource Cross-lingual Entity LinkingXingyu Fu, Weijia Shi, Xiaodong Yu, Zian Zhao 等EMNLP 2020 · 9 次引用
  3. Entity Linking in 100 LanguagesJan A. Botha, Zifei Shan, Daniel GillickEMNLP 2020
  4. DESCGEN: A Distantly Supervised Datasetfor Generating Entity DescriptionsWeijia Shi, Mandar Joshi, Luke ZettlemoyerACL 2021
  5. WebIE: Faithful and Robust Information Extraction on the WebChenxi Whitehouse, Clara Vania, Alham Fikri Aji, Christos Christodoulopoulos 等ACL 2023 · 3 次引用
黄昏的海面,两侧是细线勾勒的悬崖