OpticalNet: An Optical Imaging Dataset and Benchmark Beyond the Diffraction Limit
Benquan Wang, Ruyi An, Jin-Kyu So, Sergei Kurdiumov, Eng Aik Chan, Giorgio Adamo, Yuhan Peng, Yewen Li, Bo An
Abstract
Optical imaging capable of resolving nanoscale features would revolutionize scientific research and engineering applications across biomedicine, smart manufacturing, and semiconductor quality control. However, due to the physical phenomenon of diffraction, the optical resolution is limited to approximately half the wavelength of light, which impedes the observation of subwavelength objects such as the native state coronavirus, typically smaller than 200 nm. Fortunately, deep learning methods have shown remarkable potential in uncovering underlying patterns within data, promising to overcome the diffraction limit by revealing the mapping pattern between diffraction images and their corresponding ground truth object images. However, the absence of suitable datasets has hindered progress in this field-collecting high-quality optical data of subwavelength objects is highly difficult as these objects are inherently invisible under conventional microscopy, making it impossible to perform stan-dard visual calibration and drift correction. Therefore, we provide the first general optical imaging dataset based on the "building block" concept for challenging the diffraction limit. Drawing an analogy to modular construction principles, we construct a comprehensive optical imaging dataset comprising subwavelength fundamental elements, i.e., small square units that can be assembled into larger and more complex objects. We then frame the task as an image-toimage translation task and evaluate various vision methods. Experimental results validate our "building block" concept, demonstrating that models trained on basic square units can effectively generalize to realistic, more complex unseen objects. Most importantly, by highlighting this underexplored AI-for-science area and its potential, we aspire to advance optical science by fostering collaboration with the vision and machine learning communities.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0ae7b431-537e-469f-8019-5e8879be2f4eCited by top-tier papers1
Ask how each one uses itBuilds on13
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessTri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra et al.NeurIPS 2022 · 5,493 citations
- DDColor: Towards Photo-Realistic Image Colorization via Dual DecodersXiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren et al.ICCV 2023 · 84 citations
- Fully Unsupervised Diversity Denoising with Convolutional Variational AutoencodersMangal Prakash, Alexander Krull, Florian JugICLR 2021 · 53 citations
- Physics-Enhanced Machine Learning for Virtual Fluorescence MicroscopyColin L. V. Cooke, Fanjie Kong, Amey Chaware, Kevin C. Zhou et al.ICCV 2021 · 20 citations
- Unsupervised Learning of Object-Centric Embeddings for Cell Instance Segmentation in Microscopy ImagesSteffen Wolf, Manan Lalit, Katie McDole, Jan FunkeICCV 2023 · 11 citations
Related papers
- Learning Nanoscale Motion Patterns of Vesicles in Living CellsArif Ahmed Sekh, Ida Sundvor Opstad, Åsa Birna Birgisdottir, Truls Myrmel et al.CVPR 2020
- Unsupervised Multi-Scale Segmentation of 3D Subcellular World with Stable Diffusion Foundation ModelMostofa Rafid Uddin, H. M. Shadman Tabib, Thanh-Huy Nguyen, Kashish Gandhi et al.CVPR 2026
- Deep Optics for Video Snapshot Compressive ImagingPing Wang, Lishun Wang, Xin YuanICCV 2023 · 19 citations
- Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly DetectionJinlei Hou, Yingying Zhang, Qiaoyong Zhong, Di Xie et al.ICCV 2021 · 199 citations
- Minimizing Labeling, Maximizing Performance: A Novel Approach to Nanoscale Scanning Electron Microscope (SEM) Defect SegmentationYibo Qiao, Weiping Xie, Shunyuan Lou, Qian Jin et al.DAC 2024 · 5 citations
