Image Retargeting Quality Assessment: A Study of Subjective Scores and Objective Metrics
- 7 August 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 6 (6), 626-639
- https://doi.org/10.1109/jstsp.2012.2211996
Abstract
This paper presents the result of a recent large-scale subjective study of image retargeting quality on a collection of images generated by several representative image retargeting methods. Owning to many approaches to image retargeting that have been developed, there is a need for a diverse independent public database of the retargeted images and the corresponding subjective scores to be freely available. We build an image retargeting quality database, in which 171 retargeted images (obtained from 57 natural source images of different contents) were created by several representative image retargeting methods. And the perceptual quality of each image is subjectively rated by at least 30 viewers, meanwhile the mean opinion scores (MOS) were obtained. It is revealed that the subject viewers have arrived at a reasonable agreement on the perceptual quality of the retargeted image. Therefore, the MOS values obtained can be regarded as the ground truth for evaluating the quality metric performances. The database is made publicly available (Image Retargeting Subjective Database, [Online]. Available: http://ivp.ee.cuhk.edu.hk/projects/demo/retargeting/index.html) to the research community in order to further research on the perceptual quality assessment of the retargeted images. Moreover, the built image retargeting database is analyzed from the perspectives of the retargeting scale, the retargeting method, and the source image content. We discuss how to retarget the images according to the scale requirement and the source image attribute information. Furthermore, several publicly available quality metrics for the retargeted images are evaluated on the built database. How to develop an effective quality metric for retargeted images is discussed through a specifically designed subjective testing process. It is demonstrated that the metric performance can be further improved, by fusing the descriptors of shape distortion and content information loss.Keywords
This publication has 31 references indexed in Scilit:
- Image Retargeting Quality AssessmentComputer Graphics Forum, 2011
- Study of Rating Scales for Subjective Quality Assessment of High-Definition VideoIEEE Transactions on Broadcasting, 2010
- PatchMatchPublished by Association for Computing Machinery (ACM) ,2009
- Summarizing visual data using bidirectional similarityPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Seam carving for content-aware image resizingPublished by Association for Computing Machinery (ACM) ,2007
- A Statistical Evaluation of Recent Full Reference Image Quality Assessment AlgorithmsIEEE Transactions on Image Processing, 2006
- Image Quality Assessment: From Error Visibility to Structural SimilarityIEEE Transactions on Image Processing, 2004
- Comparing subjective video quality testing methodologiesPublished by SPIE-Intl Soc Optical Eng ,2003
- Color and texture descriptorsIEEE Transactions on Circuits and Systems for Video Technology, 2001
- The Earth Mover's Distance as a Metric for Image RetrievalInternational Journal of Computer Vision, 2000