Lune

CHI2021Top-tier venue

Communication Skills Training Intervention Based on Automated Recognition of Nonverbal Signals

Monica Pereira, Kate Hone

Abstract

There have been promising studies that show a potential of providing social signal feedback to improve communication skills. However, these studies have primarily focused on unimodal methods of feedback. In addition to this, studies do not assess whether skills are maintained after a given time. With a sample size of 22 this paper investigates whether multimodal social signal feedback is an efective method of improving communication in the context of media interviews. A pre-post experimental evaluation of media skills training intervention is presented which compares standard feedback with augmented feedback based on automated recognition of multimodal social signals. Results revealed signifcantly diferent training efects between the two conditions. However, the initial experiment study failed to show signifcant diferences in human judgement of performance. A 6-month follow-up study revealed human judgement ratings were higher for the experiment group. This study suggests that augmented selective multimodal social signal feedback is an efective method for communication skills training.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Exploring a Real-time Feedback Display of Non-verbal Cues in Online Work Meetings to Support Self-PresentationKevin Chow, Roy Rutishauser, André N. Meyer, Joanna McGrenere et al.CSCW 2025 · 5 citations

Related papers

  1. A Survey on Multi-modal Intent Recognition: Recent Advances and New FrontiersZhihong Zhu, Fan Zhang, Yunyan Zhang, Jinghan Sun et al.EMNLP Findings 2025 · 4 citations
  2. Envisioning AI Support during Semi-Structured Interviews Across the Expertise SpectrumZhe Liu, Jiamin Dai, Cristina Conati, Joanna McGrenereCSCW 2025 · 11 citations
  3. Empathic AuRea: Exploring the Effects of an Augmented Reality Cue for Emotional Sharing Across Three Face-to-Face TasksAndreia Valente, Daniel Simões Lopes, Nuno Nunes, Augusto EstevesIEEE VR 2022 · 28 citations
  4. Cross-modal Prompting for Balanced Incomplete Multi-modal Emotion RecognitionWenjue He, Xiaofeng Zhu, Zheng ZhangAAAI 2026 · 1 citation
  5. CM-BERT: Cross-Modal BERT for Text-Audio Sentiment AnalysisKaicheng Yang, Hua Xu, Kai GaoACM MM 2020 · 129 citations
Dusk over the sea between two cliffs drawn in fine vertical lines