ENRICHing Medical Imaging Training Sets Enables More Efficient Machine Learning

Abstract

Objective: Deep learning (DL) has been applied in proofs of concept across biomedical imaging, including across modalities and medical specialties^1–17. Labeled data is critical to training and testing DL models, but human expert labelers are limited. In addition, DL traditionally requires copious training data, which is computationally expensive to process and iterate over. Consequently, it is useful to prioritize using those images that are most likely to improve a model’s performance, a practice known as instance selection. The challenge is determining how best to prioritize. It is natural to prefer straightforward, robust, quantitative metrics as the basis for prioritization for instance selection. However, in current practice such metrics are not tailored to, and almost never used for, image datasets.Methods: To address this problem, we introduce ENRICH—EliminateNoise andRedundancy for ImagingChallenges—a customizable method that prioritizes images based on how much diversity each image adds to the training set.Results: First, we show that medical datasets are special in that in general each image adds less diversity than in non-medical datasets. Next, we demonstrate that ENRICH achieves nearly maximal performance on classification and segmentation tasks on several medical image datasets using only a fraction of the available images and outperforms random image selection, the negative control. Finally, we show that ENRICH can also be used to identify errors and outliers in imaging datasets.Conclusion: ENRICH is a simple, computationally efficient method for prioritizing images for expert labeling and use in DL.