Development of object detection and classification with YOLOv4 for similar and structural deformed fish
Open Access
- 31 March 2022
- journal article
- Published by OU Scientific Route in EUREKA: Physics and Engineering
- No. 2,p. 154-165
- https://doi.org/10.21303/2461-4262.2022.002345
Abstract
Food scarcity is an issue of concern due to the continued growth of the human population and the threat of global warming and climate change. Increasing food production is expected to meet the challenges of food needs that will continue to increase in the future. Automation is one of the solutions to increase food productivity, including in the aquaculture industry, where fish recognition is essential to support it. This paper presents fish recognition using YOLO version 4 (YOLOv4) on the "Fish-Pak" dataset, which contains six species of identical and structurally damaged fish, both of which are characteristics of fish processed in the aquaculture industry. Data augmentation was generated to meet the validation criteria and improve the data balance between classes. For fish images on a conveyor, flip, rotation, and translation augmentation techniques are appropriate. YOLOv4 was applied to the whole fish body and then combined with several techniques to determine the impact on the accuracy of the results. These techniques include landmarking, subclassing, adding scale data, adding head data, and class elimination. Performance for each model was evaluated with a confusion matrix, and analysis of the impact of the combination of these techniques was also reviewed. From the experimental test results, the accuracy of YOLOv4 for the whole fish body is only 43.01 %. The result rose to 72.65 % with the landmarking technique, then rose to 76.64 % with the subclassing technique, and finally rose to 77.42 % by adding scale data. The accuracy did not improve to 76.47 % by adding head data, and the accuracy rose to 98.75 % with the class elimination technique. The final result was excellent and acceptableKeywords
This publication has 34 references indexed in Scilit:
- Challenges for Industrial Robot Applications in Food ManufacturingPublished by Association for Computing Machinery (ACM) ,2018
- A Deep learning method for accurate and fast identification of coral reef fishes in underwater imagesEcological Informatics, 2018
- Deep Recurrent Neural Networks for Winter Vegetation Quality Mapping via Multitemporal SAR Sentinel-1IEEE Geoscience and Remote Sensing Letters, 2018
- Fish Species Recognition Based on CNN Using Annotated ImageLecture Notes in Electrical Engineering, 2017
- You Only Look Once: Unified, Real-Time Object DetectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- DeepFish: Accurate underwater live fish recognition with a deep architectureNeurocomputing, 2016
- Image analysis methods on fish recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Automatic Nile Tilapia fish classification approach using machine learning techniquesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Fish species classification by color, texture and multi-class support vector machine using computer visionComputers and Electronics in Agriculture, 2012
- A comparison of multi-class support vector machine and classification tree methods for hydroacoustic classification of fish-schools in ChileFisheries Research, 2011