Metalens-style image synthesis for metalens imaging via image-to-image translation.

Journal: Scientific reports
Published Date:

Abstract

Metalenses offer wafer-scale, ultra-thin optics for compact cameras, but strong chromatic and field-dependent aberrations still limit their practical use. Deep learning-based aberration correction can restore high-quality images from metalens captures, but current pipelines typically require hundreds to thousands of paired images per device. We address this data bottleneck by formulating metalens aberration synthesis as a deterministic, metalens-conditioned image-to-image translation problem. A generator is trained on a dataset of paired metalens and conventional images from a mass-producible metalens, then used to transform photographs into metalens-style outputs that reproduce realistic chromatic aberration, field-dependent blur, and spatial distortion. On a test set, the proposed translator reduces LPIPS(VGG) from 0.305 to 0.117 (∼62%) compared with a state-of-the-art transformer-based restoration baseline. Once trained, the translator can generate 600 synthetic metalens-style images in roughly 30 s on a single GPU, versus about 30 min for real metalens acquisition, a [Formula: see text] reduction in data-collection time. These synthetic pairs alone suffice to train a metalens image restoration model, suggesting that our approach can help alleviate the data bottleneck in future metalens imaging research.

Authors

  • Chanik Kang
    Department of Artificial Intelligence, Hanyang University, Seoul, 04763, Republic of Korea.
  • Hyewon Suk
    Department of Artificial Intelligence Semiconductor Engineering, Hanyang University, Seoul, 04763, Republic of Korea.
  • Joonhyuk Seo
    Department of Electrical Engineering and Computer Science, University of California Irvine, Irvine, 92697, USA.
  • Ikbeom Jang
    Department of Computer Engineering, Hankuk University of Foreign Studies, Yongin, 17035, Republic of Korea. [email protected].
  • Haejun Chung
    Department of Artificial Intelligence, Hanyang University, Seoul, 04763, Republic of Korea. [email protected].

Keywords

No keywords available for this article.