Heidelberg colorectal data set for surgical data science in the sensor operating room
Open Access
- 12 April 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in Scientific Data
- Vol. 8 (1), 1-11
- https://doi.org/10.1038/s41597-021-00882-2
Abstract
Image-based tracking of medical instruments is an integral part of surgical data science applications. Previous research has addressed the tasks of detecting, segmenting and tracking medical instruments based on laparoscopic video data. However, the proposed methods still tend to fail when applied to challenging images and do not generalize well to data they have not been trained on. This paper introduces the Heidelberg Colorectal (HeiCo) data set - the first publicly available data set enabling comprehensive benchmarking of medical instrument detection and segmentation algorithms with a specific emphasis on method robustness and generalization capabilities. Our data set comprises 30 laparoscopic videos and corresponding sensor data from medical devices in the operating room for three different types of laparoscopic surgery. Annotations include surgical phase labels for all video frames as well as information on instrument presence and corresponding instance-wise segmentation masks for surgical instruments (if any) in more than 10,000 individual frames. The data has successfully been used to organize international competitions within the Endoscopic Vision Challenges 2017 and 2019.Keywords
Funding Information
- Nationales Centrum für Tumorerkrankungen Heidelberg (N/A, N/A, N/A, N/A, N/A, N/A)
- Bundesministerium für Wirtschaft und Energie (BMWI 01MT17001C, BMWI 01MT17001C, BMWI 01MT17001C, BMWI 01MT17001C, BMWI 01MT17001C)
- Intuitive Surgical
This publication has 15 references indexed in Scilit:
- Why rankings of biomedical image analysis competitions should be interpreted with careNature Communications, 2018
- Inter-observer variability of manual contour delineation of structures in CTEuropean Radiology, 2018
- Exploiting the potential of unlabeled endoscopic video data with self-supervised learningInternational Journal of Computer Assisted Radiology and Surgery, 2018
- Surgical data science for next-generation interventionsNature Biomedical Engineering, 2017
- A Dataset and Benchmarks for Segmentation and Recognition of Gestures in Robotic SurgeryIEEE Transactions on Biomedical Engineering, 2017
- EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic VideosIEEE Transactions on Medical Imaging, 2016
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Surgical process modelling: a reviewInternational Journal of Computer Assisted Radiology and Surgery, 2013
- Comparing images using the Hausdorff distanceIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- Measures of the Amount of Ecologic Association Between SpeciesEcology, 1945