RESUMEN

Designing an effective takeover request (TOR) in conditionally automated vehicles is crucial to ensure driving safety when the system reaches its limit. In our study, we aimed to investigate the effects of looming tactile TORs (whose urgency is dynamically mapped to the situation's criticality as the vehicle approaches the upcoming obstacle) on takeover performance and subjective experience compared with conventional non-looming TORs (several tactile pulses with consistent inter-pulse intervals). In addition, the impact of the TOR urgency level (with urgency levels matched or unmatched to the situation's criticality) was considered. A total of 30 participants were recruited for this study. They were first asked to map the urgency of tactile signals to the criticality of takeover situations with various times to collision according to the recorded video clips. The looming TORs were constructed based on these mapping results. Then, a simulated driving experiment, employing a within-subject design, was conducted to explore the effects of the tactile TOR type (looming vs. non-looming) and urgency level (less urgency vs. matched urgency vs. greater urgency) on takeover performance and drivers' subjective experience. The results showed that the looming TOR can lead to a shorter takeover time and less maximum lateral acceleration compared with the non-looming TOR. Drivers also rated the looming TOR as more useful. Therefore, the looming TOR has great application potential for enhancing driving safety in automated vehicles. In addition, we found that as the TOR's level of urgency increased, the takeover time decreased. However, the TOR with an urgency level matched to the situation's criticality received higher usefulness and satisfaction ratings, suggesting that there was an important trade-off between the advantage of high-urgency TORs in speeding up driver responses and its cost of a poor experience. The findings of our study shed some light on the design and implementation of the takeover warning system for related practitioners.

RESUMEN

OBJECTIVE: This study aims to investigate the causes of take-over failures in conditional automated driving with spatial-temporal analysis of brain zone activation. BACKGROUND: Take-over requires a human driver to resume the control of the vehicle when its automation system disengages. Existing studies have found that take-over failures occur frequently on some drivers, but the causes have not been thoroughly studied. METHOD: In a driving simulator experiment, 40 drivers took over in critical freeway cut-in situations. Functional near-infrared spectroscopy (fNIRS) data were collected before and during the take-over process to evaluate brain zone activation. Successful and failed take-overs were compared with changes in fNIRS data based on spatial-temporal comparisons and cluster analysis. RESULTS: The results suggested a significant difference in temporal brain activation between take-over failure and success conditions. Take-over failure conditions are mostly related to earlier and longer brain activation in most brain zones and repeated activation of the cognition brain zones. Drivers' attention switches, steering, and braking patterns are also related to different brain zone activation orders. CONCLUSION: The results indicate the need to reduce the mental workload caused by the sudden system disengagement to prevent take-over failure. APPLICATION: Future research and implementation should focus on earlier warnings of upcoming hazards and driver education in dealing with sudden system disengagement.

RESUMEN

In the realm of conditionally automated driving, understanding the crucial transition phase after a takeover is paramount. This study delves into the concept of post-takeover stabilization by analyzing data recorded in two driving simulator experiments. By analyzing both driving and physiological signals, we investigate the time required for the driver to regain full control and adapt to the dynamic driving task following automation. Our findings show that the stabilization time varies between measured parameters. While the drivers achieved driving-related stabilization (winding, speed) in eight to ten seconds, physiological parameters (heart rate, phasic skin conductance) exhibited a prolonged response. By elucidating the temporal and cognitive dynamics underlying the stabilization process, our results pave the way for the development of more effective and user-friendly automated driving systems, ultimately enhancing safety and driving experience on the roads.

Asunto(s)

RESUMEN

By the year 2045, it is projected that Autonomous Vehicles (AVs) will make up half of the new vehicle market. Successful adoption of AVs can reduce drivers' stress and fatigue, curb traffic congestion, and improve safety, mobility, and economic efficiency. Due to the limited intelligence in relevant technologies, human-in-the-loop modalities are still necessary to ensure the safety of AVs at current or near future stages, because the vehicles may not be able to handle all emergencies. Therefore, it is important to know the takeover readiness of the drivers to ensure the takeover quality and avoid any potential accidents. To achieve this, a comprehensive understanding of the drivers' physiological states is crucial. However, there is a lack of systematic analysis of the correlation between different human physiological responses and takeover behaviors which could serve as important references for future studies to determine the types of data to use. This paper provides a comprehensive analysis of the effects of takeover behaviors on the common physiological indicators. A program for conditional automation was developed based on a game engine and applied to a driving simulator. The experiment incorporated three types of secondary tasks, three takeover events, and two traffic densities. Brain signals, Skin Conductance Level (SCL), and Heart Rate (HR) of the participants were collected while they were performing the driving simulations. The Frontal Asymmetry Index (FAI) (as an indicator of engagement) and Mental Workload (MWL) were calculated from the brain signals to indicate the mental states of the participants. The results revealed that the FAI of the drivers would slightly decrease after the takeover alerts were issued when they were doing secondary tasks prior to the takeover activities, and the higher difficulty of the secondary tasks could lead to lower overall FAI during the takeover periods. In contrast, The MWL and SCL increased during the takeover periods. The HR also increased rapidly at the beginning of the takeover period but dropped back to a normal level quickly. It was found that a fake takeover alert would lead to lower overall HR, slower increase, and lower peak of SCL during the takeover periods. Moreover, the higher traffic density scenarios were associated with higher MWL, and a more difficult secondary task would lead to higher MWL and HR during the takeover activities. A preliminary discussion of the correlation between the physiological data, takeover scenario, and vehicle data (that relevant to takeover readiness) was then conducted, revealing that although takeover event, SCL, and HR had slightly higher correlations with the maximum acceleration and reaction time, none of them dominated the takeover readiness. In addition, the analysis of the data across different participants was conducted, which emphasized the importance of considering standardization or normalization of the data when they were further used as input features for estimating takeover readiness. Overall, the results presented in this paper offer profound insights into the patterns of physiological data changes during takeover periods. These findings can be used as benchmarks for utilizing these variables as indicators of takeover preparedness and performance in future research endeavors.

Asunto(s)

RESUMEN

OBJECTIVE: This paper proposes an objective method to measure and identify trust-change directions during takeover transitions (TTs) in conditionally automated vehicles (AVs). BACKGROUND: Takeover requests (TORs) will be recurring events in conditionally automated driving that could undermine trust, and then lead to inappropriate reliance on conditionally AVs, such as misuse and disuse. METHOD: 34 drivers engaged in the non-driving-related task were involved in a sequence of takeover events in a driving simulator. The relationships and effects between drivers' physiological responses, takeover-related factors, and trust-change directions during TTs were explored by the combination of an unsupervised learning algorithm and statistical analyses. Furthermore, different typical machine learning methods were applied to establish recognition models of trust-change directions during TTs based on takeover-related factors and physiological parameters. RESULT: Combining the change values in the subjective trust rating and monitoring behavior before and after takeover can reliably measure trust-change directions during TTs. The statistical analysis results showed that physiological parameters (i.e., skin conductance and heart rate) during TTs are negatively linked with the trust-change directions. And drivers were more likely to increase trust during TTs when they were in longer TOR lead time, with more takeover frequencies, and dealing with the stationary vehicle scenario. More importantly, the F1-score of the random forest (RF) model is nearly 77.3%. CONCLUSION: The features investigated and the RF model developed can identify trust-change directions during TTs accurately. APPLICATION: Those findings can provide additional support for developing trust monitoring systems to mitigate both drivers' overtrust and undertrust in conditionally AVs.

Asunto(s)

RESUMEN

This dataset contains data of 346 drivers collected during six experiments conducted in a fixed-base driving simulator. Five studies simulated conditionally automated driving (L3-SAE), and the other one simulated manual driving (L0-SAE). The dataset includes physiological data (electrocardiogram (ECG), electrodermal activity (EDA), and respiration (RESP)), driving and behavioral data (reaction time, steering wheel angle, …), performance data of non-driving-related tasks, and questionnaire responses. Among them, measures from standardized questionnaires were collected, either to control the experimental manipulation of the driver's state, or to measure constructs related to human factors and driving safety (drowsiness, mental workload, affective state, situation awareness, situational trust, user experience). In the provided dataset, some raw data have been processed, notably physiological data from which physiological indicators (or features) have been calculated. The latter can be used as input for machine learning models to predict various states (sleep deprivation, high mental workload, ...) that may be critical for driver safety. Subjective self-reported measures can also be used as ground truth to apply regression techniques. Besides that, statistical analyses can be performed using the dataset, in particular to analyze the situational awareness or the takeover quality of drivers, in different states and different driving scenarios. Overall, this dataset contributes to better understanding and consideration of the driver's state and behavior in conditionally automated driving. In addition, this dataset stimulates and inspires research in the fields of physiological/affective computing and human factors in transportation, and allows companies from the automotive industry to better design adapted human-vehicle interfaces for safe use of automated vehicles on the roads.

RESUMEN

The goal of this on the road driving study was to investigate how drivers adapt their behavior when driving with conditional vehicle automation (SAE L3) on different occasions. Specifically, we focused on changes in how fast drivers took over control from automation and how their gaze off the road changed over time. On each of three consecutive days, 21 participants drove for 50 min, in a conditionally automated vehicle (Wizard of Oz methodology), on a typical German commuting highway. Over these rides the take-over behavior and gaze behavior were analyzed. The data show that drivers' reactions to non-critical, system initiated, take-overs took about 5.62 s and did not change within individual rides, but on average became 0.72 s faster over the three rides. After these self-paced take-over requests a final urgent take-over request was issued at the end of the third ride. In this scenario participants took over rapidly with an average of 5.28 s. This urgent take-over time was not found to be different from the self-paced take-over requests in the same ride. Regarding gaze behavior, participants' overall longest glance off the road and the percentage of time looked off the road increased within each ride, but stayed stable over the three rides. Taken together, our results suggest that drivers regularly leave the loop by gazing off the road, but multiple exposures to take-over situations in automated driving allow drivers to come back into loop faster.

Asunto(s)

RESUMEN

The objective of this study is to examine the effects of visibility and time headway on the takeover performance in L3 automated driving. Both non-critical and critical driving scenarios were considered by changing the acceleration value of the leading vehicle. A driving simulator experiment with 18 driving scenarios was conducted and 30 participants complete the experiment. Based on the data obtained from the experiment, the takeover reaction time, takeover control time, and takeover responses were analyzed. The minimum Time-To-Collision (Min TTC) was used to measure the takeover risk level and a binary logit model for takeover risk levels was estimated. The results indicate that the visibility distance (VD) has no significant effects on the takeover control time, while the time headway (THW) and the acceleration of the leading vehicle (ALV) could affect the takeover control time significantly; most of the participants would push the gas pedal to accelerate the ego vehicle as the takeover response under non-critical scenarios, while braking was the dominant takeover response for participants in critical driving scenarios; decreasing the TCT and taking the appropriate takeover response would reduce the takeover risk significantly, so it is suggested that the automation system should provide the driver with the urgency of the situation ahead and the tips for takeover responses by audio prompts or the head-up display. This study is expected to facilitate the overall understanding of the effects of visibility and time headway on the takeover performance in conditionally automated driving.

Asunto(s)

RESUMEN

Conditional automation systems allow drivers to turn their attention away from the driving task in certain scenarios but still require drivers to gain situation awareness (SA) upon a takeover request (ToR) and resume manual control when the system is unable to handle the upcoming situation. Unlike time-critical takeover situations in which drivers must respond within a relatively short time frame, the ToRs for non-critical events such as exiting from a freeway can be scheduled way ahead of time. It is unknown how the ToR lead time affects driver SA for resuming manual control and when to send the ToR is most appropriate in non-critical takeover events. The present study conducted a web-based, supervised experiment with 31 participants using conditional automation systems in freeway existing scenarios while playing a mobile game. Each participant experienced 12 trials with different ToR lead times (6, 8, 10, 12, 14, 16, 18, 20, 25, 30, 45, and 60 s) for exiting from freeways in a randomized order. Driver SA was measured by using a freeze probe technique in each trial when the participant pressed the spacebar on the laptop to simulate the takeover action. Results revealed a positive effect of longer ToR lead times on driver SA for resuming control to exit from freeways and the effect leveled off at the lead time of 16-30 s. The participants tended to postpone their takeover actions further when they were given a longer ToR lead time and it did not level off up to 60 s. Nevertheless, not all drivers waited till the last moment to take over AVs even though they did not get sufficient SA. The ToR lead time of 16-30 s was recommended for better SA; and it could be narrowed down to 25-30 s if considering the subjective evaluations on takeover readiness, workload, and trust. The findings provide implications for the future design of conditional automation systems used for freeway driving.

Asunto(s)

RESUMEN

This study explored the possibility of applying personalized takeover requests (TORs) in an automated driving system (ADS), which required drivers to regain control when the system reached its limits. A driving simulator experiment was conducted to investigate how speech-based TOR voices impacted driver performance in takeover scenarios with two lead time conditions in conditionally automated driving (level 3). Eighteen participants drove in three sessions, with each session having a different TOR voice (a synthesized male voice, a synthesized female voice, and a significant other voice). Two scenarios with a lead time of 5 s and two scenarios with a lead time of 12 s were provided per session. The driver takeover time and quality data were collected. A follow-up interview was conducted to gain a clearer understanding of the drivers' psychological feelings about each TOR voice during takeovers. Changes in takeover time and takeover quality caused by TOR voices were similar in both lead time conditions, except for the lateral acceleration. The synthesized male voice led to a larger maximum lateral acceleration than the other two voices in the 5 s condition. Interestingly, most drivers preferred choosing the synthesized female voice for future takeovers and showed negative attitudes toward the significant other voice. Our results implied that choosing TOR voices should consider the drivers' daily voice-usage habits as well as specific context of use, and personalized TOR voices should be incorporated into the ADS prudently.

Asunto(s)

RESUMEN

OBJECTIVE: At conditionally automated driving, the driver can temporarily engage in non-driving related tasks (NDRTs). However, they must safely take over control when the automated driving system reaches its operation limit. Thus, understanding the effects of the NDRTs on driver take-over performance is essential. The present work investigates the effects of various NDRTs on motor readiness in take-over scenarios during conditionally automated driving. METHODS: Three driving simulator studies were conducted. 48, 49, and 22 participants were recruited in three experiments, respectively. The participants were distracted by different NDRTs (everyday task in Experiment 1, arrow task in Experiment 2, and SuRT in Experiment 3) on a tablet mounted in the vehicle. The everyday task included reading the news and watching a video, and the arrow task included a set of arrow matrices presented to the participants in sequence. The time budgets in Experiment 1 included 3 s, 4 s, and 5 s, and the time budgets in Experiment 2 and 3 included 5 s and 7 s. A take-over request (TOR) warning was issued in the automated driving condition when the participants encountered a broken-down car in front. The participants must regain control of the vehicle with the given time budget. The hands-on time was evaluated, measuring the time from the TOR until the hands touch the steering wheel. RESULTS: The task (arrow task and SuRT), time budget (5 s and 7 s), and gender did not affect the hands-on time. However, the hands-on time for the drivers with the everyday task was significantly shorter than that for the drivers with the arrow task in the 5 s time budget. CONCLUSIONS: In conditionally automated driving, the arrow task and SuRT imposed a similar workload on readiness to take over control. Compared to the everyday task, the engagement in the arrow tasks consumed more workload on readiness to take over control.

Asunto(s)

RESUMEN

OBJECTIVE: This study aimed at investigating the driver's takeover performance when switching from working on different non-driving related tasks (NDRTs) while driving with a conditionally automated driving function (SAE L3), which was simulated by a Wizard of Oz vehicle, to manual vehicle control under naturalistic driving conditions. BACKGROUND: Conditionally automated driving systems, which are currently close to market introduction, require the user to stay fallback ready. As users will be allowed to engage in more complex NDRTs during the automated drive than when driving manually, the time needed to regain full manual control could likely be increased. METHOD: Thirty-four users engaged in different everyday NDRTs while driving automatically with a Wizard of Oz vehicle. After approximately either 5 min or 15 min of automated driving, users were requested to take back vehicle control in noncritical situations. The test drive took place in everyday traffic on German freeways in the metropolitan area of Stuttgart. RESULTS: Particularly tasks that required users to turn away from the central road scene or hold an object in their hands led to increased takeover times. Accordingly, increased variance in the driver's lane position was found shortly after the switch to manual control. However, the drivers rated the takeover situations to be mostly "harmless." CONCLUSION: Drivers managed to regain control over the vehicle safely, but they needed more time to prepare for the manual takeover when the NDRTs caused motoric workload. APPLICATION: The timings found in the study can be used to design comfortable and safe takeover concepts for automated vehicles.

Asunto(s)

RESUMEN

In this article, we examine the performance of different eye blink detection algorithms under various constraints. The goal of the present study was to evaluate the performance of an electrooculogram- and camera-based blink detection process in both manually and conditionally automated driving phases. A further comparison between alert and drowsy drivers was performed in order to evaluate the impact of drowsiness on the performance of blink detection algorithms in both driving modes. Data snippets from 14 monotonous manually driven sessions (mean 2 h 46 min) and 16 monotonous conditionally automated driven sessions (mean 2 h 45 min) were used. In addition to comparing two data-sampling frequencies for the electrooculogram measures (50 vs. 25 Hz) and four different signal-processing algorithms for the camera videos, we compared the blink detection performance of 24 reference groups. The analysis of the videos was based on very detailed definitions of eyelid closure events. The correct detection rates for the alert and manual driving phases (maximum 94%) decreased significantly in the drowsy (minus 2% or more) and conditionally automated (minus 9% or more) phases. Blinking behavior is therefore significantly impacted by drowsiness as well as by automated driving, resulting in less accurate blink detection.

Asunto(s)