Image Adjustment for Multi-Exposure Images Based on Convolutional Neural Networks
- 1 January 2022
- journal article
- research article
- Published by Institute of Electronics, Information and Communications Engineers (IEICE) in IEICE Transactions on Information and Systems
- Vol. E105.D (1), 123-133
- https://doi.org/10.1587/transinf.2021edp7087
Abstract
In this paper, we propose an image adjustment method for multi-exposure images based on convolutional neural networks (CNNs). We call image regions without information due to saturation and object moving in multi-exposure images lacking areas in this paper. Lacking areas cause the ghosting artifact in fused images from sets of multi-exposure images by conventional fusion methods, which tackle the artifact. To avoid this problem, the proposed method estimates the information of lacking areas via adaptive inpainting. The proposed CNN consists of three networks, warp and refinement, detection, and inpainting networks. The second and third networks detect lacking areas and estimate their pixel values, respectively. In the experiments, it is observed that a simple fusion method with the proposed method outperforms state-of-the-art fusion methods in the peak signal-to-noise ratio. Moreover, the proposed method is applied for various fusion methods as pre-processing, and results show obviously reducing artifacts.Keywords
This publication has 34 references indexed in Scilit:
- Dense SIFT for ghost-free multi-exposure fusionJournal of Visual Communication and Image Representation, 2015
- Robust High Dynamic Range Imaging by Rank MinimizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Ghost-Free High Dynamic Range Imaging via Rank MinimizationIEEE Signal Processing Letters, 2014
- Robust patch-based hdr reconstruction of dynamic scenesACM Transactions on Graphics, 2012
- PatchMatchACM Transactions on Graphics, 2009
- Exposure Fusion: A Simple and Practical Alternative to High Dynamic Range PhotographyComputer Graphics Forum, 2009
- Region Filling and Object Removal by Exemplar-Based Image InpaintingIEEE Transactions on Image Processing, 2004
- Modeling the space of camera response functionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held ExposuresJournal of Graphics Tools, 2003
- Image inpaintingPublished by Association for Computing Machinery (ACM) ,2000