How2Sign: A Large-Scale Multimodal Dataset for Continuous American Sign Language
Amanda Cardoso Duarte, Shruti Palaskar, Lucas Ventura, Deepti Ghadiyaram, Kenneth DeHaan, Florian Metze, Jordi Torres, Xavier Giró-i-Nieto
2021Year
51Top-tier citations
Abstract
Hi, I'm Amelia and I'm going to talk to you about how to remove gum from hair.
Green screen studio RGB videos Green screen studio RGB-D videos
Panoptic studio data (only for a subset)
Figure 1: The How2Sign dataset consists of over 80 hours of multiview sign language videos and aligned modalities.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers51
- A Simple Multi-Modality Transfer Learning Baseline for Sign Language TranslationYutong Chen, Fangyun Wei, Xiao Sun, Zhirong Wu et al.CVPR 2022 · 137 citations
- MLSLT: Towards Multilingual Sign Language TranslationAoxiong Yin, Zhou Zhao, Weike Jin, Meng Zhang et al.CVPR 2022 · 46 citations
- Open-Domain Sign Language Translation Learned from Online VideoBowen Shi, Diane Brentari, Gregory Shakhnarovich, Karen LivescuEMNLP 2022 · 39 citations
- Synthetic Smartwatch IMU Data Generation from In-the-wild ASL VideosPanneer Selvam Santhalingam, Parth Pathak, Huzefa Rangwala, Jana KoseckaUbiComp 2023 · 28 citations
- Skeleton-Aware Neural Sign Language TranslationShiwei Gan, Yafeng Yin, Zhiwei Jiang, Lei Xie et al.ACM MM 2021 · 28 citations
Builds on2
Related papers
- Sign Language Video Retrieval with Free-Form Textual QueriesAmanda Cardoso Duarte, Samuel Albanie, Xavier Giró-i-Nieto, Gül VarolCVPR 2022 · 27 citations
- Towards Privacy-Aware Sign Language Translation at ScalePhillip Rust, Bowen Shi, Skyler Wang, Necati Cihan Camgöz et al.ACL 2024
- BABEL: Bodies, Action and Behavior With English LabelsAbhinanda R. Punnakkal, Arjun Chandrasekaran, Nikos Athanasiou, Alejandra Quiros-Ramirez et al.CVPR 2021
- Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video ContentQiuheng Wang, Yukai Shi, Jiarong Ou, Rui Chen et al.CVPR 2025
- SignCLIP: Connecting Text and Sign Language by Contrastive LearningZifan Jiang, Gerard Sant, Amit Moryossef, Mathias Müller et al.EMNLP 2024 · 4 citations
