RESUMEN

Fusing data from many sources helps to achieve improved analysis and results. In this work, we present a new algorithm to fuse data from multiple cameras with data from multiple lidars. This algorithm was developed to increase the sensitivity and specificity of autonomous vehicle perception systems, where the most accurate sensors measuring the vehicle's surroundings are cameras and lidar devices. Perception systems based on data from one type of sensor do not use complete information and have lower quality. The camera provides two-dimensional images; lidar produces three-dimensional point clouds. We developed a method for matching pixels on a pair of stereoscopic images using dynamic programming inspired by an algorithm to match sequences of amino acids used in bioinformatics. We improve the quality of the basic algorithm using additional data from edge detectors. Furthermore, we also improve the algorithm performance by reducing the size of matched pixels determined by available car speeds. We perform point cloud densification in the final step of our method, fusing lidar output data with stereo vision output. We implemented our algorithm in C++ with Python API, and we provided the open-source library named Stereo PCD. This library very efficiently fuses data from multiple cameras and multiple lidars. In the article, we present the results of our approach to benchmark databases in terms of quality and performance. We compare our algorithm with other popular methods.

RESUMEN

Autonomous vehicles are rapidly advancing and have the potential to revolutionize transportation in the future. This paper primarily focuses on vehicle motion trajectory planning algorithms, examining the methods for estimating collision risks based on sensed environmental information and approaches for achieving user-aligned trajectory planning results. It investigates the different categories of planning algorithms within the scope of local trajectory planning applications for autonomous driving, discussing and differentiating their properties in detail through a review of the recent studies. The risk estimation methods are classified and introduced based on their descriptions of the sensed collision risks in traffic environments and their integration with trajectory planning algorithms. Additionally, various user experience-oriented methods, which utilize human data to enhance the trajectory planning performance and generate human-like trajectories, are explored. The paper provides comparative analyses of these algorithms and methods from different perspectives, revealing the interconnections between these topics. The current challenges and future prospects of the trajectory planning tasks in autonomous vehicles are also discussed.

RESUMEN

In this paper, a robust control method is introduced for autonomous vehicle control in different scenarios. Dual controllers have been used in this method to ensure high performance and low errors during the vehicle's trip. The new control system is called Model Predictive and Stanley based controller (MPS), which is an integration of a model predictive controller and a Stanley controller. Each of these two controllers has its drawbacks and weaknesses. The proposed method tries to overcome these points and come up with a high-performance control system. This hybrid way of combining two of the famous controllers has the benefit of using the best part of each one and trying to enhance the other part. The MPS is tested for both path-following and vehicle control in different scenarios and on both straight and curved roads. This controller has shown high performance and flexibility to deal with different scenarios of autonomous driving. The results are compared to previous types of controllers, and the proposed system outperformed these types.

RESUMEN

With the continuous development of new sensor features and tracking algorithms for object tracking, researchers have opportunities to experiment using different combinations. However, there is no standard or agreed method for selecting an appropriate architecture for autonomous vehicle (AV) crash reconstruction using multi-sensor-based sensor fusion. This study proposes a novel simulation method for tracking performance evaluation (SMTPE) to solve this problem. The SMTPE helps select the best tracking architecture for AV crash reconstruction. This study reveals that a radar-camera-based centralized tracking architecture of multi-sensor fusion performed the best among three different architectures tested with varying sensor setups, sampling rates, and vehicle crash scenarios. We provide a brief guideline for the best practices in selecting appropriate sensor fusion and tracking architecture arrangements, which can be helpful for future vehicle crash reconstruction and other AV improvement research.

RESUMEN

Vehicles equipped with automated driving capabilities have shown potential to improve safety and operations. Advanced driver assistance systems (ADAS) and automated driving systems (ADS) have been widely developed to support vehicular automation. Although the studies on the injury severity outcomes that involve automated vehicles are ongoing, there is limited research investigating the difference between injury severity outcomes for the ADAS and ADS equipped vehicles. To ensure a comprehensive analysis, a multi-source dataset that includes 1,001 ADAS crashes (SAE Level 2 vehicles) and 548 ADS crashes (SAE Level 4 vehicles) is used. Two random parameters multinomial logit models with heterogeneity in the means of random parameters are considered to gain a better understanding of the variables impacting the crash injury severity outcomes for the ADAS (SAE Level 2) and ADS (SAE Level 4) vehicles. It was found that while 67 percent of crashes involving the ADAS equipped vehicles in the dataset took place on a highway, 94 percent of crashes involving ADS took place in more urban settings. The model estimation results also reveal that the weather indicator, driver type indicator, differences in the system sophistication that are captured by both manufacture year and high/low mileage as well as rear and front contact indicators all play a role in the crash injury severity outcomes. The results offer an exploratory assessment of safety performance of the ADAS and ADS equipped vehicles using the real-world data and can be used by the manufacturers and other stakeholders to dictate the direction of their deployment and usage.

Asunto(s)

RESUMEN

Rapid advancements in connected and autonomous vehicles (CAVs) are fueled by breakthroughs in machine learning, yet they encounter significant risks from adversarial attacks. This study explores the vulnerabilities of machine learning-based intrusion detection systems (IDSs) within in-vehicle networks (IVNs) to adversarial attacks, shifting focus from the common research on manipulating CAV perception models. Considering the relatively simple nature of IVN data, we assess the susceptibility of IVN-based IDSs to manipulation-a crucial examination, as adversarial attacks typically exploit complexity. We propose an adversarial attack method using a substitute IDS trained with data from the onboard diagnostic port. In conducting these attacks under black-box conditions while adhering to realistic IVN traffic constraints, our method seeks to deceive the IDS into misclassifying both normal-to-malicious and malicious-to-normal cases. Evaluations on two IDS models-a baseline IDS and a state-of-the-art model, MTH-IDS-demonstrated substantial vulnerability, decreasing the F1 scores from 95% to 38% and from 97% to 79%, respectively. Notably, inducing false alarms proved particularly effective as an adversarial strategy, undermining user trust in the defense mechanism. Despite the simplicity of IVN-based IDSs, our findings reveal critical vulnerabilities that could threaten vehicle safety and necessitate careful consideration in the development of IVN-based IDSs and in formulating responses to the IDSs' alarms.

RESUMEN

For the RRT* algorithm, there are problems such as greater randomness, longer time consumption, more redundant nodes, and inability to perform local obstacle avoidance when encountering unknown obstacles in the path planning process of autonomous vehicles. And the artificial potential field method (APF) applied to autonomous vehicles is prone to problems such as local optimality, unreachable targets, and inapplicability to global scenarios. A fusion algorithm combining the improved RRT* algorithm and the improved artificial potential field method is proposed. First of all, for the RRT* algorithm, the concept of the artificial potential field and probability sampling optimization strategy are introduced, and the adaptive step size is designed according to the road curvature. The path post-processing of the planned global path is carried out to reduce the redundant nodes of the generated path, enhance the purpose of sampling, solve the problem where oscillation may occur when expanding near the target point, reduce the randomness of RRT* node sampling, and improve the efficiency of path generation. Secondly, for the artificial potential field method, by designing obstacle avoidance constraints, adding a road boundary repulsion potential field, and optimizing the repulsion function and safety ellipse, the problem of unreachable targets can be solved, unnecessary steering in the path can be reduced, and the safety of the planned path can be improved. In the face of U-shaped obstacles, virtual gravity points are generated to solve the local minimum problem and improve the passing performance of the obstacles. Finally, the fusion algorithm, which combines the improved RRT* algorithm and the improved artificial potential field method, is designed. The former first plans the global path, extracts the path node as the temporary target point of the latter, guides the vehicle to drive, and avoids local obstacles through the improved artificial potential field method when encountered with unknown obstacles, and then smooths the path planned by the fusion algorithm, making the path satisfy the vehicle kinematic constraints. The simulation results in the different road scenes show that the method proposed in this paper can quickly plan a smooth path that is more stable, more accurate, and suitable for vehicle driving.

RESUMEN

With remarkable advancements in the development of connected and autonomous vehicles (CAVs), the integration of teleoperation has become crucial for improving safety and operational efficiency. However, teleoperation faces substantial challenges, with network latency being a critical factor influencing its performance. This survey paper explores the impact of network latency along with state-of-the-art mitigation/compensation approaches. It examines cascading effects on teleoperation communication links (i.e., uplink and downlink) and how delays in data transmission affect the real-time perception and decision-making of operators. By elucidating the challenges and available mitigation strategies, the paper offers valuable insights for researchers, engineers, and practitioners working towards the seamless integration of teleoperation in the evolving landscape of CAVs.

RESUMEN

INTRODUCTION: Highly automated driving is expected to reduce the accident risk occurrence by human errors, but it can also increase driver distraction. Previous evidence shows that auditory signals can help drivers take over in critical situations. However, it is still uncertain whether the potential benefit of verbal auditory signals could be generalized to driving situations where drivers are visually and auditorily distracted. METHOD: Our first objective was to compare the effectiveness of complementary audio messages (audio + visual condition) and visual only (visual condition) variable message signs (VMS) messages. The second objective was to explore the potential use of oral messages with traffic information to help highly-automated vehicle drivers identify critical situations. Eye-tracking data were also registered. Twenty-four volunteers participated in a driving simulator study, completing two tasks: (a) a TV series task, where they had to pay attention to an episode of a TV series while traveling along the route; and (b) a VMS task, where they had to recover the manual control of the car if the VMS message was a 'critical message.' RESULTS: General results showed that, when the audio was available, the participants: (a) had a higher ability to discriminate the VMS messages, (b) were less conservative, (c) responded earlier, and (d) their pattern of fixations was more efficient. A complementary analysis showed that the counterbalance order was a moderating factor for the discrimination ability and the response distance measures. This evidence suggests a potential learning effect, not cancelled by counterbalancing the order of the conditions. CONCLUSION: The processing of traffic messages may improve when provided as oral and visual messages. PRACTICAL APPLICATIONS: These results would be of special interest for engineers designing highly automated cars, considering that the design of automated systems must ensure that the driver's attention is sufficient to take over control.

Asunto(s)

RESUMEN

INTRODUCTION: Development and implementation of autonomous vehicle (AV) related regulations are necessary to ensure safe AV deployment and wide acceptance among all roadway users. Assessment of vulnerable roadway users' perceptions on AV regulations could inform policymakers the development of appropriate AV regulations that facilitate the safety of diverse users in a multimodal transportation system. METHOD: This research evaluated pedestrians' and bicyclists' perceptions on six AV regulations (i.e., capping AV speed limit, operating AV in manual mode in the sensitive areas, having both pilot and co-pilot while operating AVs, and three data-sharing regulations). In addition, pedestrians' and bicyclists' perceptions of testing AVs in public streets were evaluated. Statistical testing and modeling techniques were applied to accomplish the research objectives. RESULTS: Compared to the other AV regulations assessed in this research, strong support for AV-related data sharing regulations was identified. Older respondents showed higher approval of AV testing on public roadways and less support for regulating AVs. AV technology familiarity and safe road sharing perceptions with AVs resulted in lower support for AV regulations. CONCLUSIONS: Policymakers and AV technology developers could develop effective educational tools/resources to inform pedestrians and bicyclists about AV technology reliability and soften their stance, especially on AV regulations, which could delay technology development. PRACTICAL APPLICATIONS: The findings of this research could be used to develop informed AV regulations and develop policies that could improve pedestrians' and bicyclists' attitudes/perceptions on regulating AVs and promoting AV technology deployments.

Asunto(s)

RESUMEN

With the emergence of autonomous functions in road vehicles, there has been increased use of Advanced Driver Assistance Systems comprising various sensors to perform automated tasks. Light Detection and Ranging (LiDAR) is one of the most important types of optical sensor, detecting the positions of obstacles by representing them as clusters of points in three-dimensional space. LiDAR performance degrades significantly when a vehicle is driving in the rain as raindrops adhere to the outer surface of the sensor assembly. Performance degradation behaviors include missing points and reduced reflectivity of the points. It was found that the extent of degradation is highly dependent on the interface material properties. This subsequently affects the shapes of the adherent droplets, causing different perturbations to the optical rays. A fundamental investigation is performed on the protective polycarbonate cover of a LiDAR assembly coated with four classes of material-hydrophilic, almost-hydrophobic, hydrophobic, and superhydrophobic. Water droplets are controllably dispensed onto the cover to quantify the signal alteration due to the different droplets of various sizes and shapes. To further understand the effects of droplet motion on LiDAR signals, sliding droplet conditions are simulated using numerical analysis. The results are validated with physical optical tests, using a 905 nm laser source and receiver to mimic the LiDAR detection mechanism. Comprehensive explanations of LiDAR performance degradation in rain are presented from both material and optical perspectives. These can aid component selection and the development of signal-enhancing strategies for the integration of LiDARs into vehicle designs to minimize the impact of rain.

RESUMEN

Safety is one of the most essential considerations when evaluating the performance of autonomous vehicles (AVs). Real-world AV data, including trajectory, detection, and crash data, are becoming increasingly popular as they provide possibilities for a realistic evaluation of AVs' performance. While substantial research was conducted to estimate general crash patterns utilizing structured AV crash data, a comprehensive exploration of AV crash narratives remains limited. These narratives contain latent information about AV crashes that can further the understanding of AV safety. Therefore, this study utilizes the Structural Topic Model (STM), a natural language processing technique, to extract latent topics from unstructured AV crash narratives while incorporating crash metadata (i.e., the severity and year of crashes). In total, 15 topics are identified and are further divided into behavior-related, party-related, location-related, and general topics. Using these topics, AV crashes can be systematically described and clustered. Results from the STM suggest that AVs' abilities to interact with vulnerable road users (VRUs) and react to lane-change behavior need to be further improved. Moreover, an XGBoost model is developed to investigate the relationships between the topics and crash severity. The model significantly outperforms existing studies in terms of accuracy, suggesting that the extracted topics are closely related to crash severity. Results from interpreting the model indicate that topics containing information about crash severity and VRUs have significant impacts on the model's output, which are suggested to be included in future AV crash reporting.

Asunto(s)

RESUMEN

In Level-3 autonomous driving, drivers are required to take over in an emergency upon receiving a request from an autonomous vehicle (AV). However, before the deadline for the takeover request expires, drivers are not considered fully responsible for the accident, which may make them hesitant to assume control and take on full liability before the time runs out. Therefore, to prevent problems caused by late takeover, it is important to know which factors influence a driver's willingness to take over in an emergency. To address this issue, we recruited 250 participants each for both video-based and text-based surveys to investigate the takeover decision in a dilemmatic situation that can endanger the driver, with the AV either sacrificing a group of pedestrians or the driver if the participants do not intervene. The results showed that 88.2% of respondents chose to take over when the AV intended to sacrifice the driver, while only 59.4% wanted to take over when the pedestrians would be sacrificed. Additionally, when the AV's chosen path matched the participant's intention, 77.4% chose to take over when the car intended to sacrifice the driver compared with only 34.3% when the pedestrians would be sacrificed. Furthermore, other factors such as sex, driving experience, and driving preferences partially influenced takeover decisions; however, they had a smaller effect than the situational context. Overall, our findings show that regardless of the driving intention of an AV, informing drivers that their safety is at risk can enhance their willingness to take over control of an AV in critical situations.

RESUMEN

Object detection is one of the core technologies for autonomous driving. Current road object detection mainly relies on visible light, which is prone to missed detections and false alarms in rainy, night-time, and foggy scenes. Multispectral object detection based on the fusion of RGB and infrared images can effectively address the challenges of complex and changing road scenes, improving the detection performance of current algorithms in complex scenarios. However, previous multispectral detection algorithms suffer from issues such as poor fusion of dual-mode information, poor detection performance for multi-scale objects, and inadequate utilization of semantic information. To address these challenges and enhance the detection performance in complex road scenes, this paper proposes a novel multispectral object detection algorithm called MRD-YOLO. In MRD-YOLO, we utilize interaction-based feature extraction to effectively fuse information and introduce the BIC-Fusion module with attention guidance to fuse different modal information. We also incorporate the SAConv module to improve the model's detection performance for multi-scale objects and utilize the AIFI structure to enhance the utilization of semantic information. Finally, we conduct experiments on two major public datasets, FLIR_Aligned and M3FD. The experimental results demonstrate that compared to other algorithms, the proposed algorithm achieves superior detection performance in complex road scenes.

RESUMEN

The operational efficacy of lane departure warning systems (LDWS) in autonomous vehicles is critically influenced by the retro-reflectivity of road markings, which varies with environmental wear and weather conditions. This study investigated how changes in road marking retro-reflectivity, due to factors such as weather and physical wear, impact the performance of LDWS. The study was conducted at the Yeoncheon SOC Demonstration Research Center, where various weather scenarios, including rainfall and transitions between day and night lighting, were simulated. We applied controlled wear to white, yellow, and blue road markings and measured their retro-reflectivity at multiple stages of degradation. Our methods included rigorous testing of the LDWS's recognition rates under these diverse environmental conditions. Our results showed that higher retro-reflectivity levels significantly improve the detection capability of LDWS, particularly in adverse weather conditions. Additionally, the study led to the development of a simulation framework for analyzing the cost-effectiveness of road marking maintenance strategies. This framework aims to align maintenance costs with the safety requirements of autonomous vehicles. The findings highlight the need for revising current road marking guidelines to accommodate the advanced sensor-based needs of autonomous driving systems. By enhancing retro-reflectivity standards, the study suggests a path towards optimizing road safety in the age of autonomous vehicles.

RESUMEN

This paper considers the interactive effects between the ego vehicle and other vehicles in a dynamic driving environment and proposes an autonomous vehicle lane-changing behavior decision-making and trajectory planning method based on graph convolutional networks (GCNs) and multi-segment polynomial curve optimization. Firstly, hierarchical modeling is applied to the dynamic driving environment, aggregating the dynamic interaction information of driving scenes in the form of graph-structured data. Graph convolutional neural networks are employed to process interaction information and generate ego vehicle's driving behavior decision commands. Subsequently, collision-free drivable areas are constructed based on the dynamic driving scene information. An optimization-based multi-segment polynomial curve trajectory planning method is employed to solve the optimization model, obtaining collision-free motion trajectories satisfying dynamic constraints and efficiently completing the lane-changing behavior of the vehicle. Finally, simulation and on-road vehicle experiments are conducted for the proposed method. The experimental results demonstrate that the proposed method outperforms traditional decision-making and planning methods, exhibiting good robustness, real-time performance, and strong scenario generalization capabilities.

RESUMEN

This paper presents the development of path-tracking control strategies for an over-actuated autonomous electric vehicle. The vehicle platform is equipped with four-wheel steering (4WS) as well as torque vectoring (TV) capabilities, which enable the control of vehicle dynamics to be enhanced. A nonlinear model predictive controller is proposed taking into account the nonlinearities in vehicle dynamics at the limits of handling as well as the crucial actuator constraints. Controllers with different actuation formulations are presented and compared to study the path-tracking performance of the vehicle with different levels of actuation. The controllers are implemented in a high-fidelity simulation environment considering scenarios of vehicle handling limits. According to the simulation results, the vehicle achieves the best overall path-tracking performance with combined 4WS and TV, which illustrates that the over-actuation topology can enhance the path-tracking performance during conditions under the limits of handling. In addition, the performance of the over-actuation controller is further assessed with different sampling times as well as prediction horizons in order to investigate the effect of such parameters on the control performance, and its capability for real-time execution. In the end, the over-actuation control strategy is implemented on a target machine for real-time validation. The control formulation proposed in this paper is proven to be compatible with different levels of actuation, and it is also demonstrated in this work that it is possible to include the particular over-actuation formulation and specific nonlinear vehicle dynamics in real-time operation, with the sampling time and prediction time providing a compromise between path-tracking performance and computational time.

RESUMEN

Detecting road cracks is essential for inspecting and assessing the integrity of concrete pavement structures. Traditional image-based methods often require complex preprocessing to extract crack features, making them challenging when dealing with noisy concrete surfaces in diverse real-world scenarios, such as autonomous vehicle road detection. This study introduces an image-based crack detection approach that combines a Random Forest machine learning classifier with a deep convolutional neural network (CNN) to address these challenges. Three state-of-the-art models, namely MobileNet, InceptionV3, and Xception, were employed and trained using a dataset of 30,000 images to build an effective CNN. A systematic comparison of validation accuracy across various base learning rates identified a base learning rate of 0.001 as optimal, achieving a maximum validation accuracy of 99.97%. This optimal learning rate was then applied in the subsequent testing phase. The robustness and flexibility of the trained models were evaluated using 6,000 test photos, each with a resolution of 224 × 224 pixels, which were not part of the training or validation sets. The outstanding results, boasting a remarkable 99.95% accuracy, 99.95% precision, 99.94% recall, and a matching 99.94% F1 Score, unequivocally affirm the efficacy of the proposed technique in precisely identifying road fractures in photographs taken on real concrete surfaces.

RESUMEN

The objective of this study is to explore the contributing risky factors to Autonomous Vehicle (AV) crashes and their interdependencies. AV crash data between 2015 and 2023 were collected from the autonomous vehicle collision report published by California Department of Motor Vehicles (DMV). AV crashes were categorized into four types based on vehicle damage. AV crashes features including crash location and time, driving mode, vehicle movements, crash type and vehicle damage, traffic conditions, and among others were used as potential risk factors. Association Rule Mining methods (ARM) were utilized to identify sets of contributing risky factors that often occur together in AV crashes. Several association rules suggest that AV crashes result from complex interactions between road factors, vehicle factors, and environmental conditions. No damage and minor crashes are more likely affected by the road features and traffic conditions. In contrast, the movements of vehicles are more sensitive to severe AV crashes. Improper vehicle operations could increase the probability of severe AV crashes. In addition, results suggest that adverse weather conditions could increase the damage of AV crashes. AV interactions with roadside infrastructure or vulnerable road users on wet road surfaces during the night could potentially lead to significant loss of life and property. Furthermore, the safety effects of vehicle mode on the different AV crash damage are revealed. In some contexts, the autonomous driving mode can mitigate the risk of crash damages compared with conventional driving mode. The findings of this study should be indicative of policy measures and engineering countermeasures that improve the safety and efficiency of AV on the road, ultimately improving road transportation's overall safety and reliability.

Asunto(s)

RESUMEN

The emergence of autonomous vehicles (AVs) marks a transformative leap in transportation technology. Central to the success of AVs is ensuring user safety, but this endeavor is accompanied by the challenge of establishing trust and acceptance of this novel technology. The traditional "one size fits all" approach to AVs may limit their broader societal, economic, and cultural impact. Here, we introduce the Persona-PhysioSync AV (PPS-AV). It adopts a comprehensive approach by combining personality traits with physiological and emotional indicators to personalize the AV experience to enhance trust and comfort. A significant aspect of the PPS-AV framework is its real-time monitoring of passenger engagement and comfort levels within AVs. It considers a passenger's personality traits and their interaction with physiological and emotional responses. The framework can alert passengers when their engagement drops to critical levels or when they exhibit low situational awareness, ensuring they regain attentiveness promptly, especially during Take-Over Request (TOR) events. This approach fosters a heightened sense of Human-Vehicle Interaction (HVI), thereby building trust in AV technology. While the PPS-AV framework currently provides a foundational level of state diagnosis, future developments are expected to include interaction protocols that utilize interfaces like haptic alerts, visual cues, and auditory signals. In summary, the PPS-AV framework is a pivotal tool for the future of autonomous transportation. By prioritizing safety, comfort, and trust, it aims to make AVs not just a mode of transport but a personalized and trusted experience for passengers, accelerating the adoption and societal integration of autonomous vehicles.

Asunto(s)