Interferobot: aligning an optical interferometer by a reinforcement learning agent
Dmitry Igorevich Sorokin, Alexander E. Ulanov, Ekaterina A. Sazhina, Alexander I. Lvovsky
Abstract
Limitations in acquiring training data restrict potential applications of deep reinforcement learning (RL) methods to the training of real-world robots. Here we train an RL agent to align a Mach-Zehnder interferometer, which is an essential part of many optical experiments, based on images of interference fringes acquired by a monocular camera. The agent is trained in a simulated environment, without any hand-coded features or a priori information about the physics, and subsequently transferred to a physical interferometer. Thanks to a set of domain randomizations simulating uncertainties in physical measurements, the agent successfully aligns this interferometer without any fine tuning, achieving a performance level of a human expert.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 813daf9e-09f6-433c-90d5-33217ff5644cCited by top-tier papers4
- Reinforcement learning for optimization of variational quantum circuit architecturesMateusz Ostaszewski, Lea M. Trenkwalder, Wojciech Masarczyk, Eleanor Scerri et al.NeurIPS 2021 · 204 citations
- Bayesian Optimization with High-Dimensional OutputsWesley J. Maddox, Maximilian Balandat, Andrew Gordon Wilson, Eytan BakshyNeurIPS 2021 · 75 citations
- A Study of Bayesian Neural Network Surrogates for Bayesian OptimizationYucen Lily Li, Tim G. J. Rudner, Andrew Gordon WilsonICLR 2024 · 59 citations
- Trajectory-Level Data Augmentation for Offline Reinforcement LearningTobias Schmähling, Matthias Burkhardt, Tobias WindischICML 2026
Related papers
- Understanding Domain Randomization for Sim-to-real TransferXiaoyu Chen, Jiachen Hu, Chi Jin, Lihong Li et al.ICLR 2022 · 164 citations
- Learning-based Optimisation of Particle Accelerators Under Partial Observability Without Real-World TrainingJan Kaiser, Oliver Stein, Annika EichlerICML 2022 · 22 citations
- Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions with PhysicsHaoyu Hu, Xinyu Yi, Zhe Cao, Jun-Hai Yong et al.SIGGRAPH 2024 · 2 citations
- Provably sample-efficient RL with side information about latent dynamicsYao Liu, Dipendra Misra, Miro Dudík, Robert E. SchapireNeurIPS 2022 · 2 citations
- Can Vision Language Models Learn Intuitive Physics from Interaction?Luca M. Schulze Buschoff, Konstantinos Voudouris, Can Demircan, Eric SchulzICML 2026
