256 Metaverse Records Dataset
Patrick Steinert, Stefan Wagenpfeil, Ingo Frommholz, Matthias L. Hemmje
Abstract
The metaverse is a developing field that crosses several areas of multimedia research. In this paper, we introduce the 256-MetaverseRecords dataset, a novel and extensive collection of annotated screen recordings in the form of videos from various virtual worlds of the metaverse. We describe the process of creating the dataset, the quality criteria for the annotations, and the exploration of the dataset. We also show four experiments to evaluate the performance of different feature extraction methods for Metaverse Recordings (MVRs): MVR segmentation, audio event detection, and object and interaction detection based on this dataset. Our results demonstrate that existing methods have limitations and leave challenges in dealing with the diversity and complexity of metaverse data, and that more research is needed to develop metaverse-specific techniques. Our dataset can serve as a valuable resource for the research community and foster the development of new applications and solutions for the metaverse.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- Benchmarking Audio Visual Segmentation for Long-Untrimmed VideosChen Liu, Peike Patrick Li, Qingtao Yu, Hongwei Sheng et al.CVPR 2024
- NPF-200: A Multi-Modal Eye Fixation Dataset and Method for Non-Photorealistic VideosZiyu Yang, Sucheng Ren, Zongwei Wu, Nanxuan Zhao et al.ACM MM 2023 · 2 citations
- M³AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture DatasetZhe Chen, Heyang Liu, Wenyi Yu, Guangzhi Sun et al.ACL 2024 · 2 citations
- MIntRec: A New Dataset for Multimodal Intent RecognitionHanlei Zhang, Hua Xu, Xin Wang, Qianrui Zhou et al.ACM MM 2022 · 66 citations
- A Rich Knowledge Space for Scalable Deepfake DetectionInho Jung, Hyeongjun Choi, Binh Minh Le, Hohyun Na et al.ICLR 2026
