Skeleton extraction and inpainting from poor, broken ESPI fringe with an M-net convolutional neural network
- 10 June 2020
- journal article
- research article
- Published by Optica Publishing Group in Applied Optics
- Vol. 59 (17), 5300-5308
- https://doi.org/10.1364/ao.391501
Abstract
Extracting skeletons from fringe patterns is the key to the fringe skeleton method, which is used to extract phase terms in electronic speckle pattern interferometry (ESPI). Because of massive inherent speckle noise, extracting skeletons from poor, broken ESPI fringe patterns is challenging. In this paper, we propose a method based on a modified M-net convolutional neural network for skeleton extraction from poor, broken ESPI fringe patterns. In our method, we pose the problem as a segmentation task. The M-net performs excellent segmentation, and we modify its loss function to suit our task. The broken ESPI fringe patterns and corresponding complete skeleton images are used to train the modified M-net. The trained network can extract and inpaint the skeletons simultaneously. We evaluate the performance of the network on two groups of computer-simulated ESPI fringe patterns and two groups of experimentally obtained ESPI fringe patterns. Two related recent methods, the gradient vector fields based on variational image decomposition and the U-net based method, are compared with our method. The results demonstrate that our method can obtain accurate, complete, and smooth skeletons in all cases, even where fringes are broken. It outperforms the two compared methods quantitatively and qualitatively.Funding Information
- National Natural Science Foundation of China (11772081, 11972106)
This publication has 31 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Measurement of temperature and temperature distribution in gaseous flames by digital speckle pattern shearing interferometry using holographic optical elementOptics and Lasers in Engineering, 2015
- Statistically guided improvements in speckle phase discontinuity predictions by machine learning systemsOptical Engineering, 2013
- A systematic analysis of performance measures for classification tasksInformation Processing & Management, 2009
- An introduction to ROC analysisPattern Recognition Letters, 2005
- Image Quality Assessment: From Error Visibility to Structural SimilarityIEEE Transactions on Image Processing, 2004
- Speckle interferometry for measurement of continuous deformationsOptics and Lasers in Engineering, 2003
- Fringe skeletonizing using an improved derivative sign binary methodOptics and Lasers in Engineering, 2002
- Thinning methodologies-a comprehensive surveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- Electronic speckle pattern interferometry (ESPI)Optics and Lasers in Engineering, 1989