Evaluating Cutout Rendering Techniques for Pass-Through Embodiment Using a Real-Mirror Metaphor
Kristoffer Waldow, Arnulph Fuhrmann, Daniel Roth
Abstract
A convincing sense of embodiment in virtual reality (VR) is crucial for creating immersive and engaging experiences, as it shapes how users perceive and interact with their virtual bodies. The sense of embodiment is thereby, among others, affected by the shape, appearance, and fidelity of the virtual body. However, achieving convincing avatar appearance remains a challenge for VR applications. One promising solution is Pass-Through Embodiment (PTE), which enables users to see their real bodies in VR. PTE combines depth-based segmentation with the pass-through video stream of video-see-through displays to effectively visualize photon-captured representations of their own bodies. Despite the source-fidelity of the representation, the resolution of integrated depth sensors in Head Mounted Displays (HMD) can produce artifacts at segmentation boundaries, leading to visible aliasing. The perceptual impact of these artifacts on the VR experience remains unexplored. Therefore, in this paper we compare three edge-rendering techniques designed to reduce artifacts without compromising performance. Aside from a soft gradient, we introduce two new methods with a hard and dithered edge. The latter aims to balance the sharpness of hard masks with the smoothness of gradient transitions, without relying on alpha blending. To evaluate those methods in a PTE context, we conducted a within-subjects study that introduces a novel real-mirror paradigm, using an actual physical mirror as reference for reflection. We found significant results in measured presence and embodiment. Subsequent analysis revealed that our dithered cutout approach significantly outperforms hard masks, while no significant difference was found between soft condition. These results suggest a perceptual continuum where dithering and soft blending both effectively reduce visual artifacts through gradient representation. Together with high overall ratings on presence and embodiment across all conditions, these findings confirm PTE as a robust method for supporting embodiment and presence, while highlighting the potential of dithering as a computationally efficient yet perceptually comparable alternative to smooth blending.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 18f547b3-8975-402d-8a33-8f1ff66ec513Related papers
- Investigating the Impact of Video Pass-Through Embodiment on Presence and Performance in Virtual RealityKristoffer Waldow, Constantin Kleinbeck, Arnulph Fuhrmann, Daniel RothIEEE VR 2025 · 7 citations
- Perspective-Correct VR Passthrough Without ReprojectionGrace Kuo, Eric Penner, Seth Moczydlowski, Alexander Ching et al.SIGGRAPH 2023 · 11 citations
- I'm Transforming! Effects of Visual Transitions to Change of Avatar on the Sense of Embodiment in ARRiku Otono, Adélaïde Genay, Monica Perusquía-Hernández, Naoya Isoyama et al.IEEE VR 2023 · 12 citations
- NeuralPassthrough: Learned Real-Time View Synthesis for VRLei Xiao, Salah Nouri, Joel Hegland, Alberto Garcia Garcia et al.SIGGRAPH 2022 · 29 citations
- Distance Perception with a Video See-Through Head-Mounted DisplayKevin Pfeil, Sina Masnadi, Jacob Belga, Jose-Valentin T. Sera-Josef et al.CHI 2021 · 48 citations
