Haptic Neural Fields: Bringing Tactile Interactions to 3D Rendered Scenes

Figure 1. How does an object feel when stroked with a hand? We propose a method that augments 3D scenes with object-specific tactile feedback. We train a neural field to model haptic responses conditioned on a surface material and an action. By integrating material properties with the underlying 3D geometry, the learned fields enable interactive tactile exploration: at test time, a user can input an arbitrary hand action, and the model estimates the resulting tactile signal. Here we show examples of hand interactions and the corresponding generated haptic feedback.