Lune

CHI2020Top-tier venue

Moving Toward an Ecologically Valid Data Collection Protocol for 2D Gestures In Video Games

Eugene M. Taranta II, Corey R. Pittman, Jack P. Oakley, Mykola Maslych, Mehran Maghoumi, Joseph J. LaViola

Abstract

Those who design gesture recognizers and user interfaces often use data collection applications that enable users to comfortably produce gesture training samples. In contrast, games present unique contexts that impact cognitive load and have the potential to elicit rapid gesticulations as players react to dynamic conditions, which can result in high gesture form variability. However, the extent to which these gestures differ is presently unknown. To this end, we developed two games with unique mechanics, Follow the Leader (FTL) and Sleepy Town, as well as a standard data collection application. We collected gesture samples from 18 participants across all conditions for gestures of varying complexity, and through an analysis using relative, global, and distribution coverage measures, we confirm significant differences between conditions. We discuss the implications of our findings, and show that our FTL design is closer to being an ecologically valid data collection protocol with low implementation complexity.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. The Voight-Kampff Machine for Automatic Custom Gesture Rejection Threshold SelectionEugene Matthew Taranta, Mykola Maslych, Ryan Ghamandi, Joseph J. LaViolaCHI 2022 · 2 citations

Related papers

  1. MAGIC: A Dataset Capturing Mid-Air Gesture Performance for Interaction and Feature AnalysisMasoumehsadat Hosseini, Dimitar Valkov, Donald Degraen, Heiko Müller et al.UbiComp 2026
  2. Gesture Elicitation as a Computational Optimization ProblemTheophanis Tsandilas, Pierre DragicevicCHI 2022 · 5 citations
  3. Styling Words: A Simple and Natural Way to Increase Variability in Training Data Collection for Gesture RecognitionWoojin Kang, In-Taek Jung, Daeho Lee, Jin-Hyuk HongCHI 2021 · 6 citations
  4. iFAD Gestures: Understanding Users' Gesture Input Performance with Index-Finger Augmentation DevicesRadu-Daniel VatavuCHI 2023 · 27 citations
  5. Gesture Knitter: A Hand Gesture Design Tool for Head-Mounted Mixed Reality ApplicationsGeorge B. Mo, John J. Dudley, Per Ola KristenssonCHI 2021 · 39 citations
Dusk over the sea between two cliffs drawn in fine vertical lines