Linking Attention-Based Multiscale CNN With Dynamical GCN for Driving Fatigue Detection
- 25 December 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70 (00189456), 1-11
- https://doi.org/10.1109/tim.2020.3047502
Abstract
Electroencephalography (EEG) signals have been proven to be one of the most predictive and reliable indicators for estimating driving fatigue state. However, how to make full use of EEG data for driving fatigue detection remains a challenge. Many existing methods include a time-consuming manual process or tedious parameter tunings for feature extraction, which is inconvenient to train and implement. On the other hand, most models ignore or manually determine EEG connectivity features between different channels, thus failing to thoroughly exploit the intrinsic interchannel relations for classification. In this article, we introduce a new attention-based multiscale convolutional neural network-dynamical graph convolutional network (AMCNN-DGCN) model, aiming to conquer these two issues in a unified end-to-end model. AMCNN-DGCN starts with attention-based multiscale temporal convolutions to automatically learn frequency filters to extract the salient pattern from raw EEG data. Subsequently, AMCNN-DGCN uses dynamical graph convolutional networks (DGCNs) to learn spatial filters, in which the adjacency matrix is adaptively determined in a data-driven way to exploit the intrinsic relationship between channels effectively. With the temporal–spatial structure, AMCNN-DGCN can capture highly discriminative features. To verify the effectiveness of AMCNN-DGCN, we conduct a simulated fatigue driving environment to collect EEG signals from 29 healthy subjects (male/female = 17/12 and age = 23.28±2.70 years) through a remote wireless cap with 24 channels. The results demonstrate that our proposed model outperforms six widely used competitive EEG models with high accuracy of 95.65%. Finally, the critical brain regions and connections for driving fatigue detection were investigated through the dynamically learned adjacency matrix.Keywords
Funding Information
- Special Projects in Key Fields Supported by the Technology Development Project of Guangdong Province (2020ZDZX3018)
- Special Fund for Science and Technology of Guangdong Province (2020182)
- Wuyi University and Hong Kong & Macao joint Research and Development Project (2019WGALH16)
- Science Foundation for Young Teachers of Wuyi University (2018td01)
- Jiangmen Brain-Like Computation and Hybrid Intelligence Research and Development Center ([2018]359, [2019]26)
- Scientific Research Startup Funds for High-Level Talents of Wuyi University (2020AL006)
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging (SZD201909)
- Science, Technology and Innovation Commission of Shenzhen Municipality Technology Fund (JCYJ20170818093322718)
- National Natural Science Foundation of China (81871443)
This publication has 31 references indexed in Scilit:
- Driver Fatigue Detection System Using Electroencephalography Signals Based on Combined Entropy FeaturesApplied Sciences, 2017
- EEG-based prediction of driver's cognitive performance by deep convolutional neural networkSignal Processing: Image Communication, 2016
- Classifying Driving Fatigue Based on Combined Entropy Measure Using EEG SignalsInternational Journal of Control and Automation, 2016
- Electroencephalogram assessment of mental fatigue in visual searchBio-Medical Materials and Engineering, 2015
- Drowsy Driving Detection by EEG Analysis Using Wavelet Transform and K-means ClusteringProcedia Computer Science, 2014
- Analysis of the time-varying cortical neural connectivity in the newborn EEG: A time-frequency approachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Distinct brain networks for adaptive and stable task control in humansProceedings of the National Academy of Sciences of the United States of America, 2007
- Ontology summarization based on rdf sentence graphPublished by Association for Computing Machinery (ACM) ,2007
- Independent component analysis for biomedical signalsPhysiological Measurement, 2004
- EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysisJournal of Neuroscience Methods, 2004