Assessment of mental stress effects on prefrontal cortical activities using canonical correlation analysis: an fNIRS-EEG study

This paper presents an investigation about the effects of mental stress on prefrontal cortex (PFC) subregions using simultaneous measurement of functional Near-Infrared Spectroscopy (fNIRS) and Electroencephalography (EEG) signals. The aim is to explore canonical correlation analysis (CCA) technique to study the relationship among the bi-modality signals in mental stress assessment, and how we could fuse the signals for better accuracy in stress detection. Twenty-five male healthy subjects participated in the study while performing mental arithmetic task under control and stress (under time pressure with negative feedback) conditions. The fusion of brain signals acquired by fNIRS-EEG was performed at feature-level using CCA by maximizing the inter-subject covariance across modalities. The CCA result discovered the associations across the modalities and estimated the components responsible for these associations. The experiment results showed that mental stress experienced by this cohort of subjects is subregion specific and localized to the right ventrolateral PFC subregion. These suggest the right ventrolateral PFC as a suitable candidate region to extract biomarkers as performance indicators of neurofeedback training in stress coping.