FakeForward: Using Deepfake Technology for Feedforward Learning
Christopher Clarke, Jingnan Xu, Ye Zhu, Karan Dharamshi, Harry McGill, Stephen Black, Christof Lutteroth
Abstract
Videos are commonly used to support learning of new skills, to improve existing skills, and as a source of motivation for training. Video self-modelling (VSM) is a learning technique that improves performance and motivation by showing a user a video of themselves performing a skill at a level they have not yet achieved. Traditional VSM is very data and labour intensive: a lot of video footage needs to be collected and manually edited in order to create an effective self-modelling video. We address this by presenting FakeForward – a method which uses deepfakes to create self-modelling videos from videos of other people. FakeForward turns videos of better-performing people into effective, personalised training tools by replacing their face with the user’s. We investigate how FakeForward can be effectively applied and demonstrate its efficacy in rapidly improving performance in physical exercises, as well as confidence and perceived competence in public speaking.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8da7419a-d795-4e0c-aebf-752feb5e4272Cited by top-tier papers4
- Leveraging AI-Generated Emotional Self-Voice to Nudge People towards their Ideal SelvesCathy Mengying Fang, Phoebe Chua, Samantha W. T. Chan, Joanne Leong et al.CHI 2025 · 23 citations
- Small, Medium, Large? A Meta-Study of Effect Sizes at CHI to Aid Interpretation of Effect Sizes and Power CalculationAnna-Marie Ortloff, Florin Martius, Mischa Meier, Theo Raimbault et al.CHI 2025 · 17 citations
- Does Personalized Nudging Wear Off? A Longitudinal Study of AI Self-Modeling for Behavioral EngagementQing He, Zeyu Wang, Yuzhou Du, Jiahuan Ding et al.CHI 2026 · 1 citation
- Do It Fast, Forget It Fast: How Timing and Limb Visualizations Affect First-Person Augmented Reality InstructionsClara Sayffaerth, Ehbal Ablimit, Annika Köhler, Jonas Wombacher et al.CHI 2026 · 1 citation
Builds on5
- Everybody Dance NowCaroline Chan, Shiry Ginosar, Tinghui Zhou, Alexei A. EfrosICCV 2019 · 840 citations
- Me vs. Super(wo)man: Effects of Customization and Identification in a VR ExergameJordan Koulouris, Zoe Jeffery, James Best, Eamonn O'Neill et al.CHI 2020 · 78 citations
- Race Yourselves: A Longitudinal Exploration of Self-Competition Between Past, Present, and Future Performances in a VR ExergameAlexander Michael, Christof LutterothCHI 2020 · 54 citations
- Reactive Video: Adaptive Video Playback Based on User Motion for Supporting Physical ActivityChristopher Clarke, Doga Cavdir, Patrick Chiu, Laurent Denoue et al.UIST 2020 · 30 citations
- Celeb-DF: A Large-Scale Challenging Dataset for DeepFake ForensicsYuezun Li, Xin Yang, Pu Sun, Honggang Qi et al.CVPR 2020
Related papers
- Leveraging Real Talking Faces via Self-Supervision for Robust Forgery DetectionAlexandros Haliassos, Rodrigo Mira, Stavros Petridis, Maja PanticCVPR 2022 · 138 citations
- ID-Reveal: Identity-aware DeepFake Video DetectionDavide Cozzolino, Andreas Rössler, Justus Thies, Matthias Nießner et al.ICCV 2021 · 216 citations
- DeepAware: Using Experiential Deepfake Simulations to Enhance Cybersecurity Awareness in Older AdultsHana Oh, Eunbi Lee, Seungju Shin, Keyeun Lee et al.CHI 2026 · 2 citations
- Spatio-Temporal Catcher: A Self-Supervised Transformer for Deepfake Video DetectionMaosen Li, Xurong Li, Kun Yu, Cheng Deng et al.ACM MM 2023 · 9 citations
- Joint Audio-Visual Deepfake DetectionYipin Zhou, Ser-Nam LimICCV 2021 · 232 citations
