All-day thin-lens computational imaging with scene-specific learning recovery.

Journal: Applied optics
Published Date:

Abstract

Modern imaging optics ensures high-quality photography at the cost of a complex optical form factor that deviates from the portability. The drastic development of image processing algorithms, especially advanced neural networks, shows great promise to use thin optics but still faces the challenges of residual artifacts and chromatic aberration. In this work, we investigate photorealistic thin-lens imaging that paves the way to actual applications by exploring several fine-tunes. Notably, to meet all-day photography demands, we develop a scene-specific generative-adversarial-network-based learning strategy and develop an integral automatic acquisition and processing pipeline. Color fringe artifacts are reduced by implementing a chromatic aberration pre-correction trick. Our method outperforms existing thin-lens imaging work with better visual perception and excels in both normal-light and low-light scenarios.

Authors

  • Bingyun Qi
  • Wei Chen
    Department of Urology, Zigong Fourth People's Hospital, Sichuan, China.
  • Xiong Dun
  • Xiang Hao
    College of Optical Science and Engineering, Zhejiang University, Hangzhou, China.
  • Rui Wang
    Department of Clinical Laboratory Medicine Center, Inner Mongolia Autonomous Region People's Hospital, Hohhot, Inner Mongolia, China.
  • Xu Liu
    School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore. liuxu16@bjut.edu.cn.
  • Haifeng Li
    School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China.
  • Yifan Peng
    Department of Population Health Sciences, Weill Cornell Medicine, New York, USA.