Lune

EMNLP Findings2021

Sent2Span: Span Detection for PICO Extraction in the Biomedical Text without Span Annotations

Shifeng Liu, Yifang Sun, Bing Li, Wei Wang, Florence T. Bourgeois, Adam G. Dunn

Abstract

The rapid growth in published clinical trials makes it difficult to maintain up-to-date systematic reviews, which require finding all relevant trials. This leads to policy and practice decisions based on out-of-date, incomplete, and biased subsets of available clinical evidence. Extracting and then normalising Population, Intervention, Comparator, and Outcome (PICO) information from clinical trial articles may be an effective way to automatically assign trials to systematic reviews and avoid searching and screening-the two most time-consuming systematic review processes. We propose and test a novel approach to PICO span detection. The major difference between our proposed method and previous approaches comes from detecting spans without needing annotated span data and using only crowdsourced sentence-level annotations. Experiments on two datasets show that PICO span detection results achieve much higher results for recall when compared to fully supervised methods with PICO sentence detection at least as good as human annotations. By removing the reliance on expert annotations for span detection, this work could be used in a human-machine pipeline for turning low-quality, crowdsourced, and sentence-level PICO annotations into structured information that can be used to quickly assign trials to relevant systematic reviews.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on5

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
  2. Improving the Efficiency and Effectiveness for BERT-based Entity ResolutionBing Li, Yukai Miao, Yaoshu Wang, Yifang Sun et al.AAAI 2021 · 45 citations
  3. HAMNER: Headword Amplified Multi-Span Distantly Supervised Method for Domain Specific Named Entity RecognitionShifeng Liu, Yifang Sun, Bing Li, Wei Wang et al.AAAI 2020 · 28 citations
  4. Effective Crowd-Annotation of Participants, Interventions, and Outcomes in the Text of Clinical Trial ReportsMarkus Zlabinger, Marta Sabou, Sebastian Hofstätter, Allan HanburyEMNLP Findings 2020 · 7 citations
  5. Multi-Sentence Argument LinkingSeth Ebner, Patrick Xia, Ryan Culkin, Kyle Rawlins et al.ACL 2020 · 1 citation

Related papers

  1. Predicting Clinical Trial Results by Implicit Evidence IntegrationQiao Jin, Chuanqi Tan, Mosha Chen, Xiaozhong Liu et al.EMNLP 2020 · 6 citations
  2. Predicting Intervention Approval in Clinical Trials through Multi-Document SummarizationGeorgios Katsimpras, Georgios PaliourasACL 2022
  3. Enhancing Study-Level Inference from Clinical Trial Papers via Reinforcement Learning-Based Numeric ReasoningMassimiliano Pronesti, Michela Lorandi, Paul Flanagan, Oisin Redmond et al.EMNLP 2025 · 1 citation
  4. FactPICO: Factuality Evaluation for Plain Language Summarization of Medical EvidenceSebastian Joseph, Lily Chen, Jan Trienes, Hannah Louisa Göke et al.ACL 2024 · 12 citations
  5. From Crowd Ratings to Predictive Models of Newsworthiness to Support Science JournalismSachita Nishal, Nicholas DiakopoulosCSCW 2022 · 8 citations
Dusk over the sea between two cliffs drawn in fine vertical lines