OtoMatch: Content-based eardrum image retrieval using deep learning
Open Access
- 15 May 2020
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 15 (5), e0232776
- https://doi.org/10.1371/journal.pone.0232776
Abstract
Acute infections of the middle ear are the most commonly treated childhood diseases. Because complications affect children's language learning and cognitive processes, it is essential to diagnose these diseases in a timely and accurate manner. The prevailing literature suggests that it is difficult to accurately diagnose these infections, even for experienced ear, nose, and throat (ENT) physicians. Advanced care practitioners (e.g., nurse practitioners, physician assistants) serve as first-line providers in many primary care settings and may benefit from additional guidance to appropriately determine the diagnosis and treatment of ear diseases. For this purpose, we designed a content-based image retrieval (CBIR) system (called OtoMatch) for normal, middle ear effusion, and tympanostomy tube conditions, operating on eardrum images captured with a digital otoscope. We present a method that enables the conversion of any convolutional neural network (trained for classification) into an image retrieval model. As a proof of concept, we converted a pre-trained deep learning model into an image retrieval system. We accomplished this by changing the fully connected layers into lookup tables. A database of 454 labeled eardrum images (179 normal, 179 effusion, and 96 tube cases) was used to train and test the system. On a 10-fold cross validation, the proposed method resulted in an average accuracy of 80.58% (SD 5.37%), and maximum F1 score of 0.90 while retrieving the most similar image from the database. These are promising results for the first study to demonstrate the feasibility of developing a CBIR system for eardrum images using the newly proposed methodology.Funding Information
- National Institute on Deafness and Other Communication Disorders (R21DC016972)
- National Institute on Deafness and Other Communication Disorders (R21DC016972)
This publication has 36 references indexed in Scilit:
- Content-based image retrieval for brain MRI: An image-searching engine and population-based analysis to utilize past clinical data for future diagnosisNeuroImage: Clinical, 2015
- Deep Learning for Content-Based Image RetrievalPublished by Association for Computing Machinery (ACM) ,2014
- A hybrid feature-based segmentation and classification system for the computer aided self-diagnosis of otitis media2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2014
- Automated Diagnosis of Otitis Media: Vocabulary and GrammarInternational Journal of Biomedical Imaging, 2013
- Burden of Disease Caused by Otitis Media: Systematic Review and Global EstimatesPLOS ONE, 2012
- Medical applications in case-based reasoningThe Knowledge Engineering Review, 2005
- Evaluation of shape similarity measurement methods for spine X-ray imagesJournal of Visual Communication and Image Representation, 2004
- Clinical Practice Guideline: Otitis Media with EffusionOtolaryngology -- Head and Neck Surgery, 2004
- Statistical framework for model-based image retrieval in medical applicationsJournal of Electronic Imaging, 2003
- Image retrieval using color and shapePattern Recognition, 1996