A Deep Neural Network for Real-Time Driver Drowsiness Detection

Toan H. VU  An DANG  Jia-Ching WANG  

IEICE TRANSACTIONS on Information and Systems   Vol.E102-D   No.12   pp.2637-2641
Publication Date: 2019/12/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2019EDL8079
Type of Manuscript: LETTER
Category: Image Recognition, Computer Vision
driver drowsiness detection,  ConvCGRNN,  CGRNN,  

Full Text: PDF>>
Buy this Article

We develop a deep neural network (DNN) for detecting driver drowsiness in videos. The proposed DNN model that receives driver's faces extracted from video frames as inputs consists of three components - a convolutional neural network (CNN), a convolutional control gate-based recurrent neural network (ConvCGRNN), and a voting layer. The CNN is to learn facial representations from global faces which are then fed to the ConvCGRNN to learn their temporal dependencies. The voting layer works like an ensemble of many sub-classifiers to predict drowsiness state. Experimental results on the NTHU-DDD dataset show that our model not only achieve a competitive accuracy of 84.81% without any post-processing but it can work in real-time with a high speed of about 100 fps.