Sort and Deep-SORT Based Multi-Object Tracking for Mobile Robotics: Evaluation with New Data Association Metrics
Open Access
- 26 January 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (3), 1319
- https://doi.org/10.3390/app12031319
Abstract
Multi-Object Tracking (MOT) techniques have been under continuous research and increasingly applied in a diverse range of tasks. One area in particular concerns its application in navigation tasks of assistive mobile robots, with the aim to increase the mobility and autonomy of people suffering from mobility decay, or severe motor impairments, due to muscular, neurological, or osteoarticular decay. Therefore, in this work, having in view navigation tasks for assistive mobile robots, an evaluation study of two MOTs by detection algorithms, SORT and Deep-SORT, is presented. To improve the data association of both methods, which are solved as a linear assignment problem with a generated cost matrix, a set of new object tracking data association cost matrices based on intersection over union, Euclidean distances, and bounding box metrics is proposed. For the evaluation of the MOT by detection in a real-time pipeline, the YOLOv3 is used to detect and classify the objects available on images. In addition, to perform the proposed evaluation aiming at assistive platforms, the ISR Tracking dataset, which represents the object conditions under which real robotic platforms may navigate, is presented. Experimental evaluations were also carried out on the MOT17 dataset. Promising results were achieved by the proposed object tracking data association cost matrices, showing an improvement in the majority of the MOT evaluation metrics compared to the default data association cost matrix. In addition, promising frame rate values were attained by the pipeline composed of the detector and the tracking module.Keywords
Funding Information
- Fundação para a Ciência e Tecnologia (SFRH/BD/148779/2019, SAICT/30935/2017, UIDB/00048/2020)
- Agência para o Desenvolvimento e Coesão (MATIS-CENTRO-01-0145-FEDER-000014)
This publication has 23 references indexed in Scilit:
- Feature Pyramid Networks for Object DetectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- A New Hybrid Motion Planner: Applied in a Brain-Actuated Robotic WheelchairIEEE Robotics & Automation Magazine, 2016
- Fully-Convolutional Siamese Networks for Object TrackingLecture Notes in Computer Science, 2016
- MARS: A Video Benchmark for Large-Scale Person Re-IdentificationPublished by Springer Science and Business Media LLC ,2016
- RGB-D sensor-based visual target detection and tracking for an intelligent wheelchair robot in indoors environmentsInternational Journal of Control, Automation and Systems, 2015
- Assisted navigation for a brain-actuated intelligent wheelchairRobotics and Autonomous Systems, 2013
- Object Detection and Tracking for Autonomous Navigation in Dynamic EnvironmentsThe International Journal of Robotics Research, 2010
- A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated NavigationIEEE Transactions on Robotics, 2009
- An algorithm for tracking multiple targetsIEEE Transactions on Automatic Control, 1979
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955