Optical Aberrations Correction in Postprocessing Using Imaging Simulation
- 24 September 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 40 (5), 1-15
- https://doi.org/10.1145/3474088
Abstract
As the popularity of mobile photography continues to grow, considerable effort is being invested in the reconstruction of degraded images. Due to the spatial variation in optical aberrations, which cannot be avoided during the lens design process, recent commercial cameras have shifted some of these correction tasks from optical design to postprocessing systems. However, without engaging with the optical parameters, these systems only achieve limited correction for aberrations. In this work, we propose a practical method for recovering the degradation caused by optical aberrations. Specifically, we establish an imaging simulation system based on our proposed optical point spread function model. Given the optical parameters of the camera, it generates the imaging results of these specific devices. To perform the restoration, we design a spatial-adaptive network model on synthetic data pairs generated by the imaging simulation system, eliminating the overhead of capturing training data by a large amount of shooting and registration. Moreover, we comprehensively evaluate the proposed method in simulations and experimentally with a customized digital-single-lens-reflex camera lens and HUAWEI HONOR 20, respectively. The experiments demonstrate that our solution successfully removes spatially variant blur and color dispersion. When compared with the state-of-the-art deblur methods, the proposed approach achieves better results with a lower computational overhead. Moreover, the reconstruction technique does not introduce artificial texture and is convenient to transfer to current commercial cameras. Project Page: https://github.com/TanGeeGo/ImagingSimulation.Keywords
Funding Information
- National Natural Science Foundation of China (61975175)
This publication has 56 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- FlexISPACM Transactions on Graphics, 2014
- High-contrast computational caustic designACM Transactions on Graphics, 2014
- Simultaneous image color correction and enhancement using particle swarm optimizationEngineering Applications of Artificial Intelligence, 2013
- Image Enhancement Using Calibrated Lens SimulationsLecture Notes in Computer Science, 2012
- Point spread function calibration requirements for dark energy from cosmic shearAstronomy & Astrophysics, 2008
- A Non-Local Algorithm for Image DenoisingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statisticsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Strehl ratio for primary aberrations: some analytical results for circular and annular pupilsJournal of the Optical Society of America, 1982