Shining Yourself: High-Fidelity Ornaments Virtual Try-on with Diffusion Model
Yingmao Miao, Zhanpeng Huang, Rui Han, Zibin Wang, Chenhao Lin, Chao Shen
Abstract
While virtual try-on for clothes and shoes with diffusion models has gained attraction, virtual try-on for ornaments, such as bracelets, rings, earrings, and necklaces, remains largely unexplored. Due to the intricate tiny patterns and repeated geometric sub-structures in most ornaments, it is much more difficult to guarantee identity and appearance consistency under large pose and scale variances between ornaments and models. This paper proposes the task of virtual try-on for ornaments and presents a method to improve the geometric and appearance preservation of ornament virtual try-ons. Specifically, we estimate an accurate wearing mask to improve the alignments between ornaments and models in an iterative scheme alongside the denoising process. To preserve structure details, we further regularize attention layers to map the reference ornament mask to the wearing mask in an implicit way. Experimental results demonstrate that our method successfully wears ornaments from reference images onto target models, handling substantial differences in scale and pose while preserving identity and achieving realistic visual effects.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
4 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- High-Resolution Image Synthesis with Latent Diffusion Models cites Diffusion Models Beat GANs on Image Synthesis
- High-Resolution Image Synthesis with Latent Diffusion Models cites Denoising Diffusion Probabilistic Models
- Segment Anything cites Learning Transferable Visual Models From Natural Language Supervision
- Elucidating the SNR-t Bias of Diffusion Probabilistic Models cites High-Resolution Image Synthesis with Latent Diffusion Models
- Elucidating the SNR-t Bias of Diffusion Probabilistic Models cites Diffusion Models Beat GANs on Image Synthesis
- Diffusion Models Beat GANs on Image Synthesis cites Learning Transferable Visual Models From Natural Language Supervision
- Diffusion Models Beat GANs on Image Synthesis cites Denoising Diffusion Probabilistic Models
- PhysDiff-VTON: Cross-Domain Physics Modeling and Trajectory Optimization for Virtual Try-On cites High-Resolution Image Synthesis with Latent Diffusion Models
- PhysDiff-VTON: Cross-Domain Physics Modeling and Trajectory Optimization for Virtual Try-On cites Learning Transferable Visual Models From Natural Language Supervision
- PhysDiff-VTON: Cross-Domain Physics Modeling and Trajectory Optimization for Virtual Try-On cites Denoising Diffusion Probabilistic Models
- OmniTry: Virtual Try-On Anything without Masks cites High-Resolution Image Synthesis with Latent Diffusion Models
- OmniTry: Virtual Try-On Anything without Masks cites Segment Anything
- OmniTry: Virtual Try-On Anything without Masks cites Learning Transferable Visual Models From Natural Language Supervision
- OmniTry: Virtual Try-On Anything without Masks cites Denoising Diffusion Probabilistic Models
- Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories cites OmniTry: Virtual Try-On Anything without Masks
Cited by top-tier papers4
- OmniTry: Virtual Try-On Anything without MasksYutong Feng, Linlin Zhang, Hengyuan Cao, Yiming Chen et al.NeurIPS 2025 · 16 citations
- PhysDiff-VTON: Cross-Domain Physics Modeling and Trajectory Optimization for Virtual Try-OnShibin Mei, Bingbing NiNeurIPS 2025 · 4 citations
- Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and AccessoriesJunyao Hu, Zhongwei Cheng, Waikeung Wong, Xingxing ZouCVPR 2026 · 4 citations
- Elucidating the SNR-t Bias of Diffusion Probabilistic ModelsMeng Yu, Lei Sun, Jianhao Zeng, Xiangxiang Chu et al.CVPR 2026 · 3 citations
Builds on30
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
Related papers
- GPD-VVTO: Preserving Garment Details in Video Virtual Try-OnYuanbin Wang, Weilun Dai, Long Chan, Huanyu Zhou et al.ACM MM 2024 · 4 citations
- Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-OnXu Yang, Changxing Ding, Zhibin Hong, Junhao Huang et al.CVPR 2024 · 25 citations
- Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in VideosZhengze Xu, Mengting Chen, Zhao Wang, Linyu Xing et al.ACM MM 2024 · 14 citations
- Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance FlowJunhong Gou, Siyu Sun, Jianfu Zhang, Jianlou Si et al.ACM MM 2023 · 91 citations
- Stable VITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-OnJeongho Kim, Gyojung Gu, Minho Park, Sunghyun Park et al.CVPR 2024
