Fine-tuned convolutional neural nets for cardiac MRI acquisition plane recognition
- 13 August 2015
- journal article
- research article
- Published by Informa UK Limited in Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization
- Vol. 5 (5), 339-349
- https://doi.org/10.1080/21681163.2015.1061448
Abstract
In this paper, we propose a convolutional neural network-based method to automatically retrieve missing or noisy cardiac acquisition plane information from magnetic resonance imaging and predict the five most common cardiac views. We fine-tune a convolutional neural network (CNN) initially trained on a large natural image recognition data-set (Imagenet ILSVRC2012) and transfer the learnt feature representations to cardiac view recognition. We contrast this approach with a previously introduced method using classification forests and an augmented set of image miniatures, with prediction using off the shelf CNN features, and with CNNs learnt from scratch. We validate this algorithm on two different cardiac studies with 200 patients and 15 healthy volunteers, respectively. We show that there is value in fine-tuning a model trained for natural images to transfer it to medical images. Our approach achieves an average F1 score of 97.66% and significantly improves the state-of-the-art of image-based cardiac view recognition. This is an important building block to organise and filter large collections of cardiac data prior to further analysis. It allows us to merge studies from multiple centres, to perform smarter image filtering, to select the most appropriate image processing algorithm, and to enhance visualisation of cardiac data-sets in content-based image retrieval.Keywords
This publication has 11 references indexed in Scilit:
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Cardiac MRI view classification using autoencoderPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Benchmarking framework for myocardial tracking and deformation algorithms: An open access databaseMedical Image Analysis, 2013
- Multi-column deep neural networks for image classificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Automatic view classification for cardiac MRIPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- The Cardiac Atlas Project—an imaging database for computational modeling and statistical atlases of the heartBioinformatics, 2011
- Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised LearningFoundations and Trends® in Computer Graphics and Vision, 2011
- Rationale and Design for the Defibrillators to Reduce Risk by Magnetic Resonance Imaging Evaluation (DETERMINE) TrialJournal of Cardiovascular Electrophysiology, 2009
- Exploiting spatio-temporal information for view recognition in cardiac echo videosPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998