Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Efficient and economical performance evaluation of pilots has become critical to the aviation industry. With the development of virtual reality (VR) and ...

the China Astronaut Research and Training Center

Space is characterized by risk and uncertainty. As humans play an important role in long-duration space missions, the ability to make risky decisions effectively is important for astronauts who spend extended time periods in space. The present study used the Balloon Analog Risk Task to conduct both behavioral and fMRI experiments to evaluate the effects of simulated microgravity on individuals' risk-taking behavior and the neural basis of the effect. The results showed that participants' risk-taking behavior was not affected by bed rest. However, we found that the ventromedial prefrontal cortex (VMPFC) showed less deactivation after bed rest and that the VMPFC activation in the active choice condition showed no significant difference between the win outcome and the loss outcome after bed rest, although its activation was significantly greater in the win outcome than in the loss outcome before bed rest. These results suggested that the participants showed a decreased level of value calculation after the bed rest. Our findings can contribute to a better understanding of the effect of microgravity on individual higher-level cognitive functioning.

Decreasing ventromedial prefrontal cortex deactivation in risky decision making after simulated microgravity: effects of -6° head-down tilt bed rest.

Attention is important in error processing. Few studies have examined the link between sustained attention and error processing. In this study, we examined how error-related negativity (ERN) of a four-choice reaction time task was reduced in the mental fatigue condition and investigated the role of sustained attention in error processing. Forty-one recruited participants were divided into two groups. In the fatigue experiment group, 20 subjects performed a fatigue experiment and an additional continuous psychomotor vigilance test (PVT) for 1 h. In the normal experiment group, 21 subjects only performed the normal experimental procedures without the PVT test. Fatigue and sustained attention states were assessed with a questionnaire. Event-related potential results showed that ERN (p < 0.005) and peak (p < 0.05) mean amplitudes decreased in the fatigue experiment. ERN amplitudes were significantly associated with the attention and fatigue states in electrodes Fz, FC1, Cz, and FC2. These findings indicated that sustained attention was related to error processing and that decreased attention is likely the cause of error processing impairment.

Sustained attention is associated with error processing impairment: evidence from mental fatigue study in four-choice reaction time task.

Cognitive impairment contributes to errors in different tasks. Poor attention and poor cognitive control are the two neural mechanisms for performance errors. A few studies have been conducted on the error mechanism of working memory. It is unclear whether the changes in memory updating, attention, and cognitive control can cause errors and, if so, whether they can be probed at the same time in one single task. Therefore, this study analyzed event-related potentials in a two-back working memory task. A total of 40 male participants finished the task. The differences between the error and the correct trials in amplitudes and latencies of N1, P2, N2, and P3 were analyzed. The P2 and P3 amplitudes decreased significantly in the error trials, while the N2 amplitude increased. The results showed that impaired attention, poor memory updating, and impaired cognitive control were consistently associated with the error in working memory. Furthermore, the results suggested that monitoring the neurophysiological characteristics associated with attention and cognitive control was important for studying the error mechanism and error prediction. The results also suggested that the P3 and N2 amplitudes could be used as indexes for error foreshadowing.

Cognition Impairment Prior to Errors of Working Memory Based on Event-Related Potential.

Few studies exist regarding the mechanism prior to response by which cognitive impairment may induce error in a single long-lasting task. The present study intends to clarify the changes in cognition at the electrophysiological level. Changes in amplitude and latency of N1, P2, N2, and P3 components of event-related potentials (ERPs) were analyzed for error and correct trials during normal and fatigue. Twenty-nine participants had to perform a 2-back working memory (WM) task for 100 min. The first 10 min and the last 10 min of the task were used as the normal state and fatigue state of the participant, respectively. EEG data were obtained from the first 10-min period and the final 10-min period. The results revealed smaller P3 and P2 amplitudes and longer P2 and N2 latency in the final 10-min which was after a long-lasting time task. Moreover, smaller P3 and P2 amplitudes but larger N2 amplitudes were observed in error trials for both states. Our results indicated that: (1) long lasting involvement in a cognitive task had a detrimental effect on attention, memory updating and cognitive control; and (2) impaired attention, impairments in memory updating and cognitive control were related to task errors. Our results imply that several impaired cognitive processes were consistently associated with the error and the altered ERP represents the neural patterns prior to error response in mental fatigue state.

The Neuro Patterns Prior to Error Responses in Long-Lasting Working Memory Task: An Event-Related Potential Study.

Cognitive abilities are impaired by sleep deprivation and can be recovered when sufficient sleep is obtained. Changes in alpha-band oscillations are considered to be closely related to sleep deprivation. In this study, power spectrum, source localization and functional connectivity analyses were used to investigate the changes in resting-state alpha-band activity after normal sleep, sleep deprivation and recovery sleep. The results showed that the global alpha power spectrum decreased and source activation was notably reduced in the precuneus, posterior cingulate cortex, cingulate gyrus, and paracentral lobule after sleep deprivation. Functional connectivity analysis after sleep deprivation showed a weakened functional connectivity pattern in a widespread network with the precuneus and posterior cingulate cortex as the key nodes. Furthermore, the changes caused by sleep deprivation were reversed to a certain extent but not significantly after one night of sleep recovery, which may be due to inadequate time for recovery sleep. In conclusion, large-scale resting-state alpha-band activation and functional connectivity were weakened after sleep deprivation, and the inhibition of default mode network function with the precuneus and posterior cingulate cortex as the pivotal nodes may be an important cause of cognitive impairment. These findings provide new insight into the physiological response to sleep deprivation and determine how sleep deprivation disrupts brain alpha-band oscillations.

Decreased resting-state alpha-band activation and functional connectivity after sleep deprivation.

The brain-computer interface (BCI) of steady-state visual evoked potential (SSVEP) is one of the fundamental ways of human-computer communication. The main challenge is that there may be a nonlinear relationship between different SSVEP in other states. For improving the performance of SSVEP BCI, a novel CNN algorithm model is proposed in this study. Based on the discrete Fourier transform to calculate the signal's power spectral density (PSD), we perform zero-padding in the signal's time domain to improve its performance on the PSD and make it more refined. In this way, the frequency point interval in the PSD of the SSVEP is consistent with the minimum gap between the stimulation frequency. Combining the nonlinear transformation capabilities of CNN in deep learning, a zero-padding frequency domain convolutional neural network (ZPFDCNN) model is proposed. Extensive experiments based on the SSVEP dataset validate the effectiveness of our method. The study verifies that the proposed ZPFDCNN method can improve the effectiveness of the SSVEP-based high-speed BCI ITR. It has massive potential in the application of BCI.

A Zero-Padding Frequency Domain Convolutional Neural Network for SSVEP Classification.

Previous research has shown that sleep deprivation can affect emotions and some cognitive functions. However, research on how sleep deprivation influences the visuomotor memory have rarely been reported. In the current study, a Fitts' Law task was used to investigate how movement and the visuomotor memory are affected under the condition of sleep deprivation. Experiment 1 had 36 participants (15 males, mean age = 21.61 years) complete the same Fitts' Law task 10 days apart under standard conditions. Experiment 2 had five participants (three males, mean age = 27.2 years) complete the task after 7 days of sleep deprivation, then complete it again after 10 days without sleep deprivation. Experiment 1 demonstrated the stability of the trial-to-trial effects. Experiment 2 showed that the previous trial (n) exerted no effect on the current trial (n + 1) under the conditions of sleep deprivation ( = 0.672). However, the effect was observed after 10 days without sleep deprivation ( = 0.013). This suggests that sleep deprivation did not affect task performance but influenced the transfer of the trial history. Future studies are required to investigate the effect of sleep deprivation with more participants.

Sleep Deprivation Influences Trial-to-Trial Transfer but Not Task Performance.

A considerable number of studies have described the potential neural mechanism of deception, but most deception studies have relied upon deception from experimental supervisor instruction. Experimental control (participants follow instructions to deceive without any risk) means that the deception occurs in a way that does not come close to the real deception. In the current study, a neural imaging experiment on deception closer to the real deception was conducted. Event-related potential (ERP) and event-related spectral perturbation (ERSP) techniques were used to explore the neural mechanism of deception. The results showed that deceptive response evoked larger medial-frontal negativity (MFN) and smaller response-locked positivity (RLP) than truthful response. We interpret these findings to indicate that conflict detection and emotional processing are associated with deception. In addition, magnitudes of alpha and beta oscillations after the deceptive response were significantly smaller than those after the truthful response, demonstrating that deception is associated with neural oscillations reflecting conflict adjustment. The results comprehensively characterized the physiological properties of the brain oscillations elicited by a deceptive response and provided a theoretical foundation for detection in practical applications.

The role of conflict processing mechanism in deception responses.

Hearing is one of the most important human perception forms, and humans can capture the movement of sound in complex environments. On the basis of this phenomenon, this study explored the possibility of eliciting a steady-state brain response in an intermittent periodic motion sound source. In this study, a novel discrete continuous and orderly change of sound source positions stimulation paradigm was designed based on virtual sound using head-related transfer functions (HRTFs). And then the auditory motion stimulation paradigms with different noise levels were designed by changing the signal-to-noise ratio (SNR). The characteristics of brain response and the effects of different noises on brain response were studied by analyzing electroencephalogram (EEG) signals evoked by the proposed stimulation. Experimental results showed that the proposed paradigm could elicit a novel steady-state auditory evoked potential (AEP), i.e., steady-state motion auditory evoked potential (SSMAEP). And moderate noise could enhance SSMAEP amplitude and corresponding brain connectivity. This study enriches the types of AEPs and provides insights into the mechanism of brain processing of motion sound sources and the impact of noise on brain processing.

Steady-state auditory motion based potentials evoked by intermittent periodic virtual sound source and the effect of auditory noise on EEG enhancement.

The cognitive effects of sense of agency (SoA) attract increasing attention. It is unclear how SoA influences working memory (WM). In the present study, participants first moved several boxes. One of the boxes was more or less controllable than the majority. After boxes stopped moving, to-be-remembered items appeared. Memory performance and SoA over them were subsequently tested. In Experiments 1a and 1b, the majority of boxes, serving as context, were under low and high control respectively. To further examine whether the maintenance stage was influenced, the effect of selective encoding was minimized in Experiments 2a and 2b. Experiment 2b further eliminated the impact of agency judgments and tested the relationship among SoA, WM, and preference. Memory was better for items with strong SoA in the high and low control contexts. The effect partly stems from the modulation of the maintenance stage in WM, in which reward-based processes could be engaged.

Yi Xiao

National Key Laboratory of Human Factors Engineering

the China Astronaut Research and Training Center

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

Yi Xiao

.css-o250i3{font-size:18px;font-family:Open Sans,sans-serif;line-height:21.6px;}National Key Laboratory of Human Factors Engineering

the China Astronaut Research and Training Center

Evaluating Flight Performance and Eye Movement Patterns Using Virtual Reality Flight Simulator

National Key Laboratory of Human Factors Engineering