InteRecon: Towards Reconstructing Interactivity of Personal Memorable Items in Mixed Reality
Zisu Li, Jiawei Li, Zeyu Xiong, Shumeng Zhang, Faraz Faruqi, Stefanie Mueller, Chen Liang, Xiaojuan Ma, Mingming Fan
Abstract
Digital capturing of memorable personal items is a key way to archive personal memories. Although current digitization methods (e.g., photos, videos, 3D scanning) can replicate the physical appearance of an item, they often cannot preserve its real-world interactivity. We present Interactive Digital Item (IDI), a concept of reconstructing both the physical appearance and, more importantly, the interactivity of an item. We first conducted a formative study to understand users' expectations of IDI, identifying key physical interactivity features, including geometry, interfaces, and embedded content of items. Informed by these findings, we developed InteRecon, an AR prototype enabling personal reconstruction functions for IDI creation. An exploratory study was conducted to assess the feasibility of using InteRecon and explore the potential of IDI to enrich personal memory archives. Results show that InteRecon is feasible for IDI creation, and the concept of IDI brings new opportunities for augmenting personal memory archives.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d55a07fe-99cf-4955-93ee-3dcd86c8f237Cited by top-tier papers3
- ExplorAR: Assisting Older Adults to Learn Smartphone Apps through AR-powered Trial-and-Error with Interactive GuidanceJiawei Li, Linjie Qiu, Zhiqing Wu, Qiongyan Chen et al.ACM MM 2025 · 3 citations
- HOICraft: In-Situ VLM-based Authoring Tool for Part-Level Hand-Object Interaction Design in VRDohui Lee, Qi Sun, Sang Ho YoonCHI 2026 · 1 citation
- RealTwin: Concept Graph Representation and Grounding Framework for Reality-Preserving Digital Twin ReconstructionZisu Li, Ruohao Li, Jiawei Li, Chao Liu et al.CHI 2026 · 1 citation
Builds on25
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann et al.ICLR 2024 · 4,569 citations
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li et al.ICLR 2024 · 3,079 citations
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 1,720 citations
- VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual RealityYing Jiang, Chang Yu, Tianyi Xie, Xuan Li et al.SIGGRAPH 2024 · 153 citations
- GestureDiffuCLIP: Gesture Diffusion Model with CLIP LatentsTenglong Ao, Zeyi Zhang, Libin LiuSIGGRAPH 2023 · 151 citations
Related papers
- Ditto: Building Digital Twins of Articulated Objects from InteractionZhenyu Jiang, Cheng-Chun Hsu, Yuke ZhuCVPR 2022 · 77 citations
- ADIO: An Interactive Artifact Physically Representing the Intangible Digital Audiobook Listening Experience in Everyday Living SpacesKyung-Ryong Lee, Beom Kim, Junyoung Kim, Hwajung Hong et al.CHI 2021 · 13 citations
- FUN REC * Reconstructing Functional 3D Scenes from Egocentric Interaction VideosAlexandros Delitzas, Chenyangguang Zhang, Alexey Gavryushin, Tommaso Di Mario et al.CVPR 2026
- SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed RealityLeon Müller, Ken Pfeuffer, Jan Gugenheimer, Bastian Pfleging et al.CHI 2021 · 33 citations
- Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and EnactionGermán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, Paul AsenteCHI 2020 · 96 citations
