Survey and comparative analysis of entropy and relative entropy thresholding techniques
- 1 January 2006
- journal article
- Published by Institution of Engineering and Technology (IET) in IEE Proceedings - Vision, Image, and Signal Processing
- Vol. 153 (6), 837-850
- https://doi.org/10.1049/ip-vis:20050032
Abstract
Entropy-based image thresholding has received considerable interest in recent years. Two types of entropy are generally used as thresholding criteria: Shannon's entropy and relative entropy, also known as Kullback–Leibler information distance, where the former measures uncertainty in an information source with an optimal threshold obtained by maximising Shannon's entropy, whereas the latter measures the information discrepancy between two different sources with an optimal threshold obtained by minimising relative entropy. Many thresholding methods have been developed for both criteria and reported in the literature. These two entropy-based thresholding criteria have been investigated and the relationship among entropy and relative entropy thresholding methods has been explored. In particular, a survey and comparative analysis is conducted among several widely used methods that include Pun and Kapur's maximum entropy, Kittler and Illingworth's minimum error thresholding, Pal and Pal's entropy thresholding and Chang et al.'s relative entropy thresholding methods. In order to objectively assess these methods, two measures, uniformity and shape, are used for performance evaluation.Keywords
This publication has 27 references indexed in Scilit:
- Fast recursive algorithms for two-dimensional thresholdingPattern Recognition, 1998
- Image thresholding based on Ali-Silvey distance measuresPattern Recognition, 1997
- Gray level image thresholding based on fisher linear projection of two-dimensional histogramPattern Recognition, 1997
- Threshold selection using Renyi's entropyPattern Recognition, 1997
- On minimum cross-entropy thresholdingPattern Recognition, 1996
- A fast two-dimensional entropic thresholding algorithmPattern Recognition, 1994
- Minimum cross entropy thresholdingPattern Recognition, 1993
- Thresholding of digital images using two-dimensional entropiesPattern Recognition, 1992
- Entropy: a new definition and its applicationsIEEE Transactions on Systems, Man, and Cybernetics, 1991
- Minimum error thresholdingPattern Recognition, 1986