Deep Coupled ResNet for Low-Resolution Face Recognition
Top Cited Papers
- 27 February 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 25 (4), 526-530
- https://doi.org/10.1109/lsp.2018.2810121
Abstract
Face images captured by surveillance cameras are often of low resolution (LR), which adversely affects the performance of their matching with high-resolution (HR) gallery images. Existing methods including super resolution, coupled mappings (CMs), multidimensional scaling, and convolutional neural network yield only modest performance. In this letter, we propose the deep coupled ResNet (DCR) model. It consists of one trunk network and two branch networks. The trunk network, trained by face images of three significantly different resolutions, is used to extract discriminative features robust to the resolution change. Two branch networks, trained by HR images and images of the targeted LR, work as resolution-specific CMs to transform HR and corresponding LR features to a space where their difference is minimized. Model parameters of branch networks are optimized using our proposed CM loss function, which considers not only the discriminability of HR and LR features, but also the similarity between them. In order to deal with various possible resolutions of probe images, we train multiple pairs of small branch networks while using the same trunk network. Thorough evaluation on LFW and SCface databases shows that the proposed DCR model achieves consistently and considerably better performance than the state of the arts.Keywords
Funding Information
- Rapid-Rich Object Search Laboratory, Nanyang Technological University, Singapore
- Infocomm Media Development Authority, Singapore
- Singapore Ministry of Education Academic Research Fund (RG 123/15)
This publication has 24 references indexed in Scilit:
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet ClassificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Robust Face Recognition via Multimodal Deep Face RepresentationIEEE Transactions on Multimedia, 2015
- Low Resolution Face Recognition Across Variations in Pose and IlluminationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- FaceNet: A unified embedding for face recognition and clusteringPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- A Color Channel Fusion Approach for Face RecognitionIEEE Signal Processing Letters, 2015
- CaffePublished by Association for Computing Machinery (ACM) ,2014
- From Local Geometry to Global Structure: Learning Latent Subspace for Low-resolution Face Image RecognitionIEEE Signal Processing Letters, 2014
- Pose-Robust Recognition of Low-Resolution Face ImagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Coupled Marginal Fisher Analysis for Low-Resolution Face RecognitionLecture Notes in Computer Science, 2012
- SCface – surveillance cameras face databaseMultimedia Tools and Applications, 2009