RESUMEN

INTRODUCTION: It is critical to develop and implement lab-based computer experiments that simulate real-world tasks in order to characterize operational requirements and challenges or identify potential solutions. Achieving a high degree of laboratory control, operational generalizability, and ease-of-use for a task is challenging, often leading to the development of tasks that can satisfy some facets but not all. This can result in insufficient solutions that leave real-world stakeholders with unsolved problems. MATERIALS AND METHODS: This issue is addressed using a customized passive sonar simulator application that provides extensive researcher control over the design and manipulation of a sonar task; a visual appearance and cognitive demand similar to a true submarine-based sonar task; and a convenient and short training routine for sonar novices. The task requires participants to watch for multiple signal sources of varying appearance and salience and subsequently classify these signals into their respective categories. RESULTS: The current study investigated the effects of stimulus signal strength and signal density on sonar task performance-including metrics of classification accuracy, classification confidence, and response times-finding an interaction between signal density and signal strength that resulted in greater performance errors with high signal density at the weakest signal strength. CONCLUSIONS: The lab-based sonar application provides new possibilities for research, not limited to signal intensity and signal density but also through the manipulation of parameters such as the number of unique targets, target appearance, and task duration. This application may illuminate the operational demands that each of these factors may have on operator behavior within the dynamic tasks.

Asunto(s)

RESUMEN

The low-prevalence effect (LPE) is the finding that target detection rates decline as targets become less frequent in a visual search task. A major source of this effect is thought to be that fewer targets result in lower quitting thresholds, i.e., observers respond target-absent after looking at fewer items compared to searches with a higher prevalence of targets. However, a lower quitting threshold does not directly account for an LPE in searches where observers continuously monitor a dynamic display for targets. In these tasks there are no discrete "trials" to which a quitting threshold could be applied. This study examines whether the LPE persists in this type of dynamic search context. Experiment 1 was a 2 (dynamic/static) x 2 (10%/40% prevalence targets) design. Although overall performance was worse in the dynamic task, both tasks showed a similar magnitude LPE. In Experiment 2, we replicated this effect using a task where subjects searched for either of two targets (Ts and Ls). One target appeared infrequently (10%) and the other moderately (40%). Given this method of manipulating prevalence rate, the quitting threshold explanation does not account for the LPE even for static displays. However, replicating Experiment 1, we found an LPE of similar magnitude for both search scenarios, and lower target detection rates with the dynamic displays, demonstrating the LPE is a potential concern for both static and dynamic searches. These findings suggest an activation threshold explanation of the LPE may better account for our observations than the traditional quitting threshold model.

RESUMEN

We have performed a direct comparison between facial features obtained from a webcam and vigilance-task performance during prolonged wakefulness. Prolonged wakefulness deteriorates working performance due to changes in cognition, emotion, and by delayed response. Facial features can be potentially collected everywhere using webcams located in the workplace. If this type of device can obtain relevant information to predict performance deterioration, this technology can potentially reduce serious accidents and fatality. We extracted 34 facial indices, including head movements, facial expressions, and perceived facial emotions from 20 participants undergoing the psychomotor vigilance task (PVT) over 25 hours. We studied the correlation between facial indices and the performance indices derived from PVT, and evaluated the feasibility of facial indices as detectors of diminished reaction time during the PVT. Furthermore, we tested the feasibility of classifying performance as normal or impaired using several machine learning algorithms with correlated facial indices. Twenty-one indices were found significantly correlated with PVT indices. Pitch, from the head movement indices, and four perceived facial emotions-anger, surprise, sadness, and disgust-exhibited significant correlations with indices of performance. The eye-related facial expression indices showed especially strong correlation and higher feasibility of facial indices as classifiers. Significantly correlated indices were shown to explain more variance than the other indices for most of the classifiers. The facial indices obtained from a webcam strongly correlate with working performance during 25 hours of prolonged wakefulness.

Asunto(s)

RESUMEN

High risk professions, such as pilots, police officers, and TSA agents, require sustained vigilance over long periods of time and/or under conditions of little sleep. This can lead to performance impairment in occupational tasks. Predicting impaired states before performance decrement manifests is critical to prevent costly and damaging mistakes. We hypothesize that machine learning models developed to analyze indices of eye and face tracking technologies can accurately predict impaired states. To test this we trained 12 types of machine learning algorithms using five methods of feature selection with indices of eye and face tracking to predict the performance of individual subjects during a psychomotor vigilance task completed at 2-h intervals during a 25-h sleep deprivation protocol. Our results show that (1) indices of eye and face tracking are sensitive to physiological and behavioral changes concomitant with impairment; (2) methods of feature selection heavily influence classification performance of machine learning algorithms; and (3) machine learning models using indices of eye and face tracking can correctly predict whether an individual's performance is "normal" or "impaired" with an accuracy up to 81.6%. These methods can be used to develop machine learning based systems intended to prevent operational mishaps due to sleep deprivation by predicting operator impairment, using indices of eye and face tracking.

RESUMEN

We studied the correlation between oscillatory brain activity and performance in healthy subjects performing the error awareness task (EAT) every 2 h, for 24 h. In the EAT, subjects were shown on a screen the names of colors and were asked to press a key if the name of the color and the color it was shown in matched, and the screen was not a duplicate of the one before ("Go" trials). In the event of a duplicate screen ("Repeat No-Go" trial) or a color mismatch ("Stroop No-Go" trial), the subjects were asked to withhold from pressing the key. We assessed subjects' (N = 10) response inhibition by measuring accuracy of the "Stroop No-Go" (SNGacc) and "Repeat No-Go" trials (RNGacc). We assessed their reactivity by measuring reaction time in the "Go" trials (GRT). Simultaneously, nine electroencephalographic (EEG) channels were recorded (Fp2, F7, F8, O1, Oz, Pz, O2, T7, and T8). The correlation between reactivity and response inhibition measures to brain activity was tested using quantitative measures of brain activity based on the relative power of gamma, beta, alpha, theta, and delta waves. In general, response inhibition and reactivity reached a steady level between 6 and 16 h of sleep deprivation, which was followed by sustained impairment after 18 h. Channels F7 and Fp2 had the highest correlation to the indices of performance. Measures of response inhibition (RNGacc and SNGacc) were correlated to the alpha and theta waves' power for most of the channels, especially in the F7 channel (r = 0.82 and 0.84, respectively). The reactivity (GRT) exhibited the highest correlation to the power of gamma waves in channel Fp2 (0.76). We conclude that quantitative measures of EEG provide information that can help us to better understand changes in subjects' performance and could be used as an indicator to prevent the adverse consequences of sleep deprivation.

RESUMEN

Indices of heart rate variability (HRV) and electrodermal activity (EDA), in conjunction with machine learning models, were used to identify one of three tasks a subject is performing based on autonomic response elicited by the specific task. Using non-invasive measures to identify the task performed by a subject can help to provide individual monitoring and guidance to avoid the consequences of reduced performance due to fatigue or other stressors. In the present study, sixteen subjects were enrolled to undergo three tasks: The psychomotor vigilance task (PVT), an auditory working memory task (the n-back paradigm), and a visual search (ship search, SS). Electrocardiogram (ECG) (for HRV analysis) and EDA data were collected during the tests. For task-classification, we tested four machine learning classification tools: k-nearest neighbor classifier (KNN), support vector machines (SVM), decision trees, and discriminant analysis (DA). Leave-one-subject-out cross-validation was used to evaluate the performance of the constructed models to prevent overfitting. The most accurate models were the KNN (66%), linear SVM (62%), and linear DA (62%). The results of this study showed that it is possible to identify the task a subject is performing based on the subject's autonomic reactions (from HRV and EDA). This information can be used to monitor individuals within a larger group to assist in reducing errors caused by uncoordinated or poor performance by allowing for automated tracking of and communication between individuals.

RESUMEN

BACKGROUND: Understanding human behavior under the effects of sleep deprivation allows for the mitigation of risk due to reduced performance. To further this goal, this study investigated the effects of short-term sleep deprivation using a tilt-based control device and examined whether existing user models accurately predict targeting performance. METHODS: A task in which the user tilts a surface to roll a ball into a target was developed to examine motor performance. A model was built to predict human performance for this task under various levels of sleep deprivation. Every 2 h, 10 subjects completed the task until they reached 24 h of wakefulness. Performance measurements of this task, which were based on Fitts' law, included movement time, task throughput, and time intercept. RESULTS: The model predicted significant performance decrements over the 24-h period with an increase in movement time (R2 = 0.61), a decrease in throughput (R2 = 0.57), and an increase in time intercept (R2 = 0.60). However, it was found that in experimental trials there was no significant change in movement time (R2 = 0.11), throughput (R2 = 0.15), or time intercept (R2 = 0.27). DISCUSSION: The results found were unexpected as performance decrement is frequently reported during sleep deprivation. These findings suggest a reexamination of the initial thought of sleep loss leading to a decrement in all aspects of performance.Bolkovsky JB, Ritter FE, Chon KH, Qin M. Performance trends during sleep deprivation on a tilt-based control task. Aerosp Med Hum Perform. 2018; 89(7):626-633.

Asunto(s)

RESUMEN

OBJECTIVE: The aim was to determine if indices of the autonomic nervous system (ANS), derived from the electrodermal activity (EDA) and electrocardiogram (ECG), could be used to detect deterioration in human cognitive performance on healthy participants during 24-hour sleep deprivation. BACKGROUND: The ANS is highly sensitive to sleep deprivation. METHODS: Twenty-five participants performed a desktop-computer-based version of the psychomotor vigilance task (PVT) every 2 hours. Simultaneously with reaction time (RT) and false starts from PVT, we measured EDA and ECG. We derived heart rate variability (HRV) measures from ECG recordings to assess dynamics of the ANS. Based on RT values, average reaction time (avRT), minor lapses (RT > 500 ms), and major lapses (RT > 1 s) were computed as indices of performance, along with the total number of false starts. RESULTS: Performance measurement results were consistent with the literature. The skin conductance level, the power spectral index, and the high-frequency components of HRV were not significantly correlated to the indices of performance. The nonspecific skin conductance responses, the time-varying index of EDA (TVSymp), and normalized low-frequency components of HRV were significantly correlated to indices of performance ( p < 0.05). TVSymp exhibited the highest correlation to avRT (-0.92), major lapses (-0.85), and minor lapses (-0.83). CONCLUSION: We conclude that indices that account for high-frequency dynamics in the EDA, specifically the time-varying approach, constitute a valuable tool for understanding the changes in the autonomic nervous system. APPLICATION: This can be used to detect the adverse effects of prolonged wakefulness on human performance.

Asunto(s)

RESUMEN

We analyzed multiple measures of the autonomic nervous system (ANS) based on electrodermal activity (EDA) and heart rate variability (HRV) for young healthy subjects undergoing 24-h sleep deprivation. In this study, we have utilized the error awareness test (EAT) every 2 h (13 runs total), to evaluate the deterioration of performance. EAT consists of trials where the subject is presented words representing colors. Subjects are instructed to press a button ("Go" trials) or withhold the response if the word presented and the color of the word mismatch ("Stroop No-Go" trial), or the screen is repeated ("Repeat No-Go" trials). We measured subjects' (N = 10) reaction time to the "Go" trials, and accuracy to the "Stroop No-Go" and "Repeat No-Go" trials. Simultaneously, changes in EDA and HRV indices were evaluated. Furthermore, the relationship between reactiveness and vigilance measures and indices of sympathetic control based on HRV were analyzed. We found the performance improved to a stable level from 6 through 16 h of deprivation, with a subsequently sustained impairment after 18 h. Indices of higher frequencies of EDA related more to vigilance measures, whereas lower frequencies index (skin conductance leve, SCL) measured the reactiveness of the subject. We conclude that indices of EDA, including those of the higher frequencies, termed TVSymp, EDASymp, and NSSCRs, provide information to better understand the effect of sleep deprivation on subjects' autonomic response and performance.

RESUMEN

Accurate estimation of heart rates from photoplethysmogram (PPG) signals during intense physical activity is a very challenging problem. This is because strenuous and high intensity exercise can result in severe motion artifacts in PPG signals, making accurate heart rate (HR) estimation difficult. In this study we investigated a novel technique to accurately reconstruct motion-corrupted PPG signals and HR based on time-varying spectral analysis. The algorithm is called Spectral filter algorithm for Motion Artifacts and heart rate reconstruction (SpaMA). The idea is to calculate the power spectral density of both PPG and accelerometer signals for each time shift of a windowed data segment. By comparing time-varying spectra of PPG and accelerometer data, those frequency peaks resulting from motion artifacts can be distinguished from the PPG spectrum. The SpaMA approach was applied to three different datasets and four types of activities: (1) training datasets from the 2015 IEEE Signal Process. Cup Database recorded from 12 subjects while performing treadmill exercise from 1 km/h to 15 km/h; (2) test datasets from the 2015 IEEE Signal Process. Cup Database recorded from 11 subjects while performing forearm and upper arm exercise. (3) Chon Lab dataset including 10 min recordings from 10 subjects during treadmill exercise. The ECG signals from all three datasets provided the reference HRs which were used to determine the accuracy of our SpaMA algorithm. The performance of the SpaMA approach was calculated by computing the mean absolute error between the estimated HR from the PPG and the reference HR from the ECG. The average estimation errors using our method on the first, second and third datasets are 0.89, 1.93 and 1.38 beats/min respectively, while the overall error on all 33 subjects is 1.86 beats/min and the performance on only treadmill experiment datasets (22 subjects) is 1.11 beats/min. Moreover, it was found that dynamics of heart rate variability can be accurately captured using the algorithm where the mean Pearson's correlation coefficient between the power spectral densities of the reference and the reconstructed heart rate time series was found to be 0.98. These results show that the SpaMA method has a potential for PPG-based HR monitoring in wearable devices for fitness tracking and health monitoring during intense physical activities.

Asunto(s)

RESUMEN

Video recordings of finger tips made using a smartphone camera contain a pulsatile component caused by the cardiac pulse equivalent to that present in a photoplethysmographic signal. By performing peak detection on the pulsatile signal it is possible to extract a continuous heart rate signal. We performed direct comparisons between 5-lead electrocardiogram based heart rate variability measurements and those obtained from an iPhone 4s and Motorola Droid derived pulsatile signal to determine the accuracy of heart rate variability measurements obtained from the smart phones. Monitoring was performed in the supine and tilt positions for independent iPhone 4s (2 min recordings, n=9) and Droid (5 min recordings, n=13) experiments, and the following heart rate and heart rate variability parameters were estimated: heart rate, low frequency power, high frequency power, ratio of low to high frequency power, standard deviation of the RR intervals, and root mean square of successive RR-differences. Results demonstrate that accurate heart rate variability parameters can be obtained from smart phone based measurements.

Asunto(s)