An open-source, citizen science and machine learning approach to analyse subsea movies
Open Access
- 24 February 2021
- journal article
- research article
- Published by Pensoft Publishers in Biodiversity Data Journal
- Vol. 9, e60548
- https://doi.org/10.3897/bdj.9.e60548
Abstract
This paper describes a data system to analyse large amounts of subsea movie data for marine ecological research. The system consists of three distinct modules for data management and archiving, citizen science, and machine learning in a high performance computation environment. It allows scientists to upload underwater footage to a customised citizen science website hosted by Zooniverse, where volunteers from the public classify the footage. Classifications with high agreement among citizen scientists are then used to train machine learning algorithms. An application programming interface allows researchers to test the algorithms and track biological objects in new footage. We tested our system using recordings from remotely operated vehicles (ROVs) in a Marine Protected Area, the Kosterhavet National Park in Sweden. Results indicate a strong decline of cold-water corals in the park over a period of 15 years, showing that our system allows to effectively extract valuable occurrence and abundance data for key ecological species from underwater footage. We argue that the combination of citizen science tools, machine learning, and high performance computers are key to successfully analyse large amounts of image data in the future, suggesting that these services should be consolidated and interlinked by national and international research infrastructures.Novel information system to analyse marine underwater footage.Keywords
Funding Information
- VINNOVA
This publication has 11 references indexed in Scilit:
- Video Image Enhancement and Machine Learning Pipeline for Underwater Animal Detection and Classification at Cabled ObservatoriesSensors, 2020
- Research infrastructure challenges in preparing essential biodiversity variables data products for alien invasive speciesEnvironmental Research Letters, 2018
- The Accuracy of Citizen Science Data: A Quantitative ReviewBulletin of the Ecological Society of America, 2017
- A Review of the Tools Used for Marine Monitoring in the UK: Combining Historic and Contemporary Methods with Modeling and Socioeconomics to Fulfill Legislative Needs and Scientific AmbitionsFrontiers in Marine Science, 2017
- Building essential biodiversity variables (EBVs) of species distribution and abundance at a global scaleBiological Reviews, 2017
- Implementing and Innovating Marine Monitoring Approaches for Assessing Marine Environmental StatusFrontiers in Marine Science, 2016
- Towards Automated Annotation of Benthic Survey Images: Variability of Human Experts and Operational Modes of AutomationPLOS ONE, 2015
- Essential Biodiversity VariablesScience, 2013
- Cold-Water Corals on the Tisler Reef: Preliminary observations on the dynamic reef environmentOceanography, 2009
- Role of cold-water Lophelia pertusa coral reefs as fish habitat in the NE AtlanticPublished by Springer Science and Business Media LLC ,2005