TY - GEN
T1 - Prediction of Response Time and Vigilance Score in a Sustained Attention Task from Pre-trial Phase Synchrony using Deep Neural Networks
AU - Torkamani-Azar, Mastaneh
AU - Kanik, Sumeyra Demir
AU - Ali Ahmed, Sara Atito
AU - Aydin, Serap
AU - Cetin, Mujdat
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/7
Y1 - 2019/7
N2 - A real-time assessment of sustained attention requires a continuous performance measure ideally obtained objectively and without disrupting the ongoing behavioral patterns. In this work, we investigate whether the phasic functional connectivity patterns from short-and long-range attention networks can predict the tonic performance in a long Sustained Attention to Response Task (SART). Pre-trial phase synchrony indices (PSIs) from individual experiment blocks are used as features for assessment of the proposed average cumulative vigilance score (CVS) and hit response time (HRT). Deep neural networks (DNNs) with the mean-squared-error (MSE) loss function outperformed the ones with mean-absolute-error (MAE) in 4-fold cross-validations. PSI features from the 16-20 Hz beta sub-band obtained the lowest RMSE of 0.043 and highest correlation of 0.806 for predicting the average CVS, and the alpha oscillation PSIs resulted in an RMSE of 51.91 ms and a correlation of 0.903 for predicting the mean HRT. The proposed system can be used for monitoring performance of users susceptible to hypo-or hyper-vigilance and the subsequent system adaptation without implemented eye trackers. To the best of our knowledge, functional connectivity features in general and phase locking values in particular have not been used for regression models of vigilance variations with neural networks.
AB - A real-time assessment of sustained attention requires a continuous performance measure ideally obtained objectively and without disrupting the ongoing behavioral patterns. In this work, we investigate whether the phasic functional connectivity patterns from short-and long-range attention networks can predict the tonic performance in a long Sustained Attention to Response Task (SART). Pre-trial phase synchrony indices (PSIs) from individual experiment blocks are used as features for assessment of the proposed average cumulative vigilance score (CVS) and hit response time (HRT). Deep neural networks (DNNs) with the mean-squared-error (MSE) loss function outperformed the ones with mean-absolute-error (MAE) in 4-fold cross-validations. PSI features from the 16-20 Hz beta sub-band obtained the lowest RMSE of 0.043 and highest correlation of 0.806 for predicting the average CVS, and the alpha oscillation PSIs resulted in an RMSE of 51.91 ms and a correlation of 0.903 for predicting the mean HRT. The proposed system can be used for monitoring performance of users susceptible to hypo-or hyper-vigilance and the subsequent system adaptation without implemented eye trackers. To the best of our knowledge, functional connectivity features in general and phase locking values in particular have not been used for regression models of vigilance variations with neural networks.
UR - https://www.scopus.com/pages/publications/85077872099
U2 - 10.1109/EMBC.2019.8856291
DO - 10.1109/EMBC.2019.8856291
M3 - Conference contribution
C2 - 31945988
AN - SCOPUS:85077872099
T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
SP - 676
EP - 679
BT - 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2019
Y2 - 23 July 2019 through 27 July 2019
ER -