Sparse Feature Fidelity for Perceptual Image Quality Assessment
- 6 June 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 22 (10), 4007-4018
- https://doi.org/10.1109/tip.2013.2266579
Abstract
The prediction of an image quality metric (IQM) should be consistent with subjective human evaluation. As the human visual system (HVS) is critical to visual perception, modeling of the HVS is regarded as the most suitable way to achieve perceptual quality predictions. Sparse coding that is equivalent to independent component analysis (ICA) can provide a very good description of the receptive fields of simple cells in the primary visual cortex, which is the most important part of the HVS. With this inspiration, a quality metric called sparse feature fidelity (SFF) is proposed for full-reference image quality assessment (IQA) on the basis of transformation of images into sparse representations in the primary visual cortex. The proposed method is based on the sparse features that are acquired by a feature detector, which is trained on samples of natural images by an ICA algorithm. In addition, two strategies are designed to simulate the properties of the visual perception: 1) visual attention and 2) visual threshold. The computation of SFF has two stages: training and fidelity computation, in addition, the fidelity computation consists of two components: feature similarity and luminance correlation. The feature similarity measures the structure differences between the two images, whereas the luminance correlation evaluates brightness distortions. SFF also reflects the chromatic properties of the HVS, and it is very effective for color IQA. The experimental results on five image databases show that SFF has a better performance in matching subjective ratings compared with the leading IQMs.Keywords
This publication has 41 references indexed in Scilit:
- No-reference image and video quality estimation: Applications and human-motivated designSignal Processing: Image Communication, 2010
- Image Quality Assessment: From Error Visibility to Structural SimilarityIEEE Transactions on Image Processing, 2004
- Natural Image Statistics and Neural RepresentationAnnual Review of Neuroscience, 2001
- Redundancy reduction revisitedNetwork: Computation in Neural Systems, 2001
- Image quality assessment based on a degradation modelIEEE Transactions on Image Processing, 2000
- Fast and robust fixed-point algorithms for independent component analysisIEEE Transactions on Neural Networks, 1999
- Sparse coding with an overcomplete basis set: A strategy employed by V1?Vision Research, 1997
- Visual instrument image-quality assessment with rotationally symmetric difference of GaussiansApplied Optics, 1997
- Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature, 1996
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995