TokenHand: Discrete Token Representation for Efficient Hand Mesh Reconstruction
Xinguo He, Yixin Shen, Rahul Chaudhari
摘要
Hand mesh reconstruction has attracted growing attention in recent years. Despite significant progress, existing methods often struggle to balance reconstruction quality and inference efficiency. In this work, we propose TokenHand, a novel framework for single-view 3D hand mesh reconstruction that achieves both high accuracy and real-time inference. Our method represents a 3D hand model using M discrete tokens, each describing a specific sub-structure of the hand. This compositional representation enables efficient modeling with minimal reconstruction error. Furthermore, we reformulate hand mesh reconstruction as a classification problem rather than a regression task. Specifically, a classifier predicts the categories of the M tokens from an input image, and a pre-trained decoder network subsequently reconstructs the 3D hand mesh from the predicted tokens without any post-processing. Extensive experiments demonstrate that TokenHand achieves comparable or superior performance to existing methods across standard benchmarks, while maintaining high efficiency in practical scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper34
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer 等NeurIPS 2021 · 被引用 3,862 次
- MetaFormer is Actually What You Need for VisionWeihao Yu, Mi Luo, Pan Zhou, Chenyang Si 等CVPR 2022 · 被引用 1,114 次
- FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape From Single RGB ImagesChristian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan C. Russell 等ICCV 2019 · 被引用 493 次
- Mesh GraphormerKevin Lin, Lijuan Wang, Zicheng LiuICCV 2021 · 被引用 399 次
- FastViT: A Fast Hybrid Vision Transformer using Structural ReparameterizationPavan Kumar Anasosalu Vasu, James Gabriel, Jeff Zhu, Oncel Tuzel 等ICCV 2023 · 被引用 341 次
相关 Paper
- A Simple Baseline for Efficient Hand Mesh ReconstructionZhishan Zhou, Shihao Zhou, Zhi Lv, Minqiang Zou 等CVPR 2024 · 被引用 18 次
- End-to-End Hand Mesh Recovery From a Monocular RGB ImageXiong Zhang, Qiang Li, Hong Mo, Wenbo Zhang 等ICCV 2019 · 被引用 248 次
- MaskHand: Generative Masked Modeling for Robust Hand Mesh Reconstruction in the WildMuhammad Usama Saleem, Ekkasit Pinyoanuntapong, Mayur Jagdishbhai Patel, Hongfei Xue 等ICCV 2025 · 被引用 2 次
- TORE: Token Reduction for Efficient Human Mesh Recovery with TransformerZhiyang Dou, Qingxuan Wu, Cheng Lin, Zeyu Cao 等ICCV 2023 · 被引用 56 次
- H2ONet: Hand-Occlusion-and-Orientation-Aware Network for Real-Time 3D Hand Mesh ReconstructionHao Xu, Tianyu Wang, Xiao Tang, Chi-Wing FuCVPR 2023
