Deep Learning-Based Automatic Monitoring Method for Grain Quantity Change in Warehouse Using Semantic Segmentation
- 3 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70, 1-10
- https://doi.org/10.1109/tim.2021.3056743
Abstract
The quantity security of stored grain in warehouses is crucial for a country. Since manual inspection of stored grain quantity is inefficient, some online automeasurement methods have been proposed recently, but they are either time-consuming or too expensive to be popularized. This article proposes a deep learning-based method to automatically monitor changes in grain quantity of granaries. First, the image of the same scene in a granary is taken at different moments using a device that integrates a camera and an infrared laser rangefinder. Then, a deep semantic segmentation model based on an encoder-decoder framework is developed to extract the grain loading line and grain surface of the image. Finally, the distance and area between the extracted grain loading line and grain surface are calculated and compared with the previous measured one to determine whether the grain quantity of the granary has changed. To improve the accuracy of the segmentation results, a novel reverse attention model is proposed to provide guidance information to fuse low-level features, which calculates multiscale attention maps based only on the output of the last layer of the encoder. Furthermore, the proposed method and infrared laser rangefinder-based method are combined to get more accurate grain volume after an abnormal change of grain quantity is detected by our method. Experimental results show that our method is effective and feasible for monitoring changes in grain quantity and outperforms the state-of-the-art methods on semantic segmentation.Keywords
Funding Information
- Natural Science Project of the Henan Science and Technology Department (162102210189, 212102210148)
- Special Fund for Basic Scientific Research of the Henan University of Technology (2016QNJH25)
- Open Fund of the Key Laboratory of Grain Information Processing and Control (KFJJ-2018-101)
This publication has 47 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Fully convolutional networks for semantic segmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Review on grain quantity recognition methods based on computer visionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Semantic Segmentation with Second-Order PoolingLecture Notes in Computer Science, 2012
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Robust Higher Order Potentials for Enforcing Label ConsistencyInternational Journal of Computer Vision, 2009
- The Key of Bulk Warehouse Grain Quantity RecognitionPublished by Springer Science and Business Media LLC ,2008
- TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and ContextInternational Journal of Computer Vision, 2007