RESUMEN

BACKGROUND: A daily activity routine is vital for overall health and well-being, supporting physical and mental fitness. Consistent physical activity is linked to a multitude of benefits for the body, mind, and emotions, playing a key role in raising a healthy lifestyle. The use of wearable devices has become essential in the realm of health and fitness, facilitating the monitoring of daily activities. While convolutional neural networks (CNN) have proven effective, challenges remain in quickly adapting to a variety of activities. OBJECTIVE: This study aimed to develop a model for precise recognition of human activities to revolutionize health monitoring by integrating transformer models with multi-head attention for precise human activity recognition using wearable devices. METHODS: The Human Activity Recognition (HAR) algorithm uses deep learning to classify human activities using spectrogram data. It uses a pretrained convolution neural network (CNN) with a MobileNetV2 model to extract features, a dense residual transformer network (DRTN), and a multi-head multi-level attention architecture (MH-MLA) to capture time-related patterns. The model then blends information from both layers through an adaptive attention mechanism and uses a SoftMax function to provide classification probabilities for various human activities. RESULTS: The integrated approach, combining pretrained CNN with transformer models to create a thorough and effective system for recognizing human activities from spectrogram data, outperformed these methods in various datasets - HARTH, KU-HAR, and HuGaDB produced accuracies of 92.81%, 97.98%, and 95.32%, respectively. This suggests that the integration of diverse methodologies yields good results in capturing nuanced human activities across different activities. The comparison analysis showed that the integrated system consistently performs better for dynamic human activity recognition datasets. CONCLUSION: In conclusion, maintaining a routine of daily activities is crucial for overall health and well-being. Regular physical activity contributes substantially to a healthy lifestyle, benefiting both the body and the mind. The integration of wearable devices has simplified the monitoring of daily routines. This research introduces an innovative approach to human activity recognition, combining the CNN model with a dense residual transformer network (DRTN) with multi-head multi-level attention (MH-MLA) within the transformer architecture to enhance its capability.

RESUMEN

BACKGROUND: Accurately measuring energy expenditure during physical activity outside of the laboratory is challenging, especially on a large scale. Thigh-worn accelerometers have gained popularity due to the possibility to accurately detect physical activity types. The use of machine learning techniques for activity classification and energy expenditure prediction may improve accuracy over current methods. Here, we developed a novel composite energy expenditure estimation model by combining an activity classification model with a stride specific energy expenditure model for walking, running, and cycling. METHODS: We first trained a supervised deep learning activity classification model using pooled data from available adult accelerometer datasets. The composite energy expenditure model was then developed and validated using additional data based on a sample of 69 healthy adult participants (49% female; age = 25.2 ± 5.8 years) who completed a standardised activity protocol with indirect calorimetry as the reference measure. RESULTS: The activity classification model showed an overall accuracy of 99.7% across all five activity types during validation. The composite model for estimating energy expenditure achieved a mean absolute percentage error of 10.9%. For running, walking, and cycling, the composite model achieved a mean absolute percentage error of 6.6%, 7.9% and 16.1%, respectively. CONCLUSIONS: The integration of thigh-worn accelerometers with machine learning models provides a highly accurate method for classifying physical activity types and estimating energy expenditure. Our novel composite model approach improves the accuracy of energy expenditure measurements and supports better monitoring and assessment methods in non-laboratory settings.

Asunto(s)

RESUMEN

Introduction: Construction worker safety remains a major concern even as task automation increases. Although safety incentives have been introduced to encourage safety compliance, it is still difficult to accurately measure the effectiveness of these measures. A simple count of accident rates and lower numbers do not necessarily mean that workers are properly complying with safety regulations. To address this problem, this study proposes an image-based approach to monitor moment-by-moment worker safety behavior and evaluate the effects of different safety incentive scenarios. Methods: By capturing workers' safety behaviors using a model integrated with OpenPose and spatiotemporal graph convolutional network, this study evaluated the effects of safety-incentive scenarios on workers' compliance with rules while on the job. The safety incentive scenarios in this study were designed as 1) varying the type (i.e., providing rewards and penalties) of incentives and 2) varying the frequency of feedback about ones' own compliance status during tasks. The effects of the scenarios were compared to the average compliance rates of three safety regulations (i.e., personal protective equipment self-monitoring hazard avoidance, and arranging the safety hook) for each scenario. Results: The results show that 1) rewarding a good-compliance is more effective when there is no feedback on compliance status, and 2) penalizing non-compliance is more effective when there are three feedbacks during the tasks. Discussion: This study provides a more accurate assessment of safety incentives and their effectiveness by focusing on safe behaviors to promote safety compliance among construction workers.

Asunto(s)

RESUMEN

Continuous and unobtrusive monitoring of daily human activities in homes can potentially improve the quality of life and prolong independent living for the elderly and people with chronic diseases by recognizing normal daily activities and detecting gradual changes in their conditions. However, existing human activity recognition (HAR) solutions employ wearable and video-based sensors, which either require dedicated devices to be carried by the user or raise privacy concerns. Radar sensors enable non-intrusive long-term monitoring, while they can exploit existing communication systems, e.g., Wi-Fi, as illuminators of opportunity. This survey provides an overview of passive radar system architectures, signal processing techniques, feature extraction, and machine learning's role in HAR applications. Moreover, it points out challenges in wireless human activity sensing research like robustness, privacy, and multiple user activity sensing and suggests possible future directions, including the coexistence of sensing and communications and the construction of open datasets.

RESUMEN

BACKGROUND: The ActiPASS software was developed from the open-source Acti4 activity classification algorithm for thigh-worn accelerometry. However, the original algorithm has not been validated in children or compared with a child-specific set of algorithm thresholds. This study aims to evaluate the accuracy of ActiPASS in classifying activity types in children using 2 published sets of Acti4 thresholds. METHODS: Laboratory and free-living data from 2 previous studies were used. The laboratory condition included 41 school-aged children (11.0 [4.8] y; 46.5% male), and the free-living condition included 15 children (10.0 [2.6] y; 66.6% male). Participants wore a single accelerometer on the dominant thigh, and annotated video recordings were used as a reference. Postures and activity types were classified with ActiPASS using the original adult thresholds and a child-specific set of thresholds. RESULTS: Using the original adult thresholds, the mean balanced accuracy (95% CI) for the laboratory condition ranged from 0.62 (0.56-0.67) for lying to 0.97 (0.94-0.99) for running. For the free-living condition, accuracy ranged from 0.61 (0.48-0.75) for lying to 0.96 (0.92-0.99) for cycling. Mean balanced accuracy for overall sedentary behavior (sitting and lying) was ≥0.97 (0.95-0.99) across all thresholds and conditions. No meaningful differences were found between the 2 sets of thresholds, except for superior balanced accuracy of the adult thresholds for walking under laboratory conditions. CONCLUSIONS: The results indicate that ActiPASS can accurately classify different basic types of physical activity and sedentary behavior in children using thigh-worn accelerometer data.

RESUMEN

Introduction: Falls are a major cause of accidents that can lead to serious injuries, especially among geriatric populations worldwide. Ensuring constant supervision in hospitals or smart environments while maintaining comfort and privacy is practically impossible. Therefore, fall detection has become a significant area of research, particularly with the use of multimodal sensors. The lack of efficient techniques for automatic fall detection hampers the creation of effective preventative tools capable of identifying falls during physical exercise in long-term care environments. The primary goal of this article is to examine the benefits of using multimodal sensors to enhance the precision of fall detection systems. Methods: The proposed paper combines time-frequency features of inertial sensors with skeleton-based modeling of depth sensors to extract features. These multimodal sensors are then integrated using a fusion technique. Optimization and a modified K-Ary classifier are subsequently applied to the resultant fused data. Results: The suggested model achieved an accuracy of 97.97% on the UP-Fall Detection dataset and 97.89% on the UR-Fall Detection dataset. Discussion: This indicates that the proposed model outperforms state-of-the-art classification results. Additionally, the proposed model can be utilized as an IoT-based solution, effectively promoting the development of tools to prevent fall-related injuries.

RESUMEN

The behavior of pedestrians in a non-constrained environment is difficult to predict. In wearable robotics, this poses a challenge, since devices like lower-limb exoskeletons and active orthoses need to support different walking activities, including level walking and climbing stairs. While a fixed movement trajectory can be easily supported, switches between these activities are difficult to predict. Moreover, the demand for these devices is expected to rise in the years ahead. In this work, we propose a cloud software system for use in wearable robotics, based on geographical mapping techniques and Human Activity Recognition (HAR). The system aims to give context to the surrounding pedestrians by providing hindsight information. The system was partially implemented and tested. The results indicate a viable concept with great extensibility prospects.

Asunto(s)

RESUMEN

Epilepsy is one of the most frequent neurological illnesses caused by epileptic seizures and the second most prevalent neurological ailment after stroke, affecting millions of people worldwide. People with epileptic disease are considered a category of people with disabilities. It significantly impairs a person's capacity to perform daily tasks, especially those requiring focusing or remembering. Electroencephalogram (EEG) signals are commonly used to diagnose people with epilepsy. However, it is tedious, time-consuming, and subjected to human errors. Several machine learning techniques have been applied to recognize epilepsy previously, but they have some limitations. This study proposes a deep neural network (DNN) machine learning model to determine the existing limitations of previous studies by improving the recognition efficiency of epileptic disease. A public dataset is used in this study and classified into training and testing sets. Experiments were performed to evaluate the DNN model with different dataset classification ratios (80:20), (70:30), (60:40), and (50:50) for training and testing, respectively. Results were evaluated by using different performance metrics including validations, and comparison processes that allow the assessment of the model's effectiveness. The experimental results showed that the overall efficiency of the proposed model is the highest compared with previous works, with an accuracy rate of 97%. Thus, this study is more accurate and efficient than the existing seizure detection approaches. DNN model has great potential for recognizing epileptic patient activity using a numerical EEG dataset offering a data-driven approach to improve the accuracy and reliability of seizure detection systems for the betterment of patient care and management of epilepsy.

RESUMEN

Lower urinary tract dysfunction (LUTD) is a debilitating condition that affects millions of individuals worldwide, greatly diminishing their quality of life. The use of wireless, catheter-free implantable devices for long-term ambulatory bladder monitoring, combined with a single-sensor system capable of detecting various bladder events, has the potential to significantly enhance the diagnosis and treatment of LUTD. However, these systems produce large amounts of bladder data that may contain physiological noise in the pressure signals caused by motion artifacts and sudden movements, such as coughing or laughing, potentially leading to false positives during bladder event classification and inaccurate diagnosis/treatment. Integration of activity recognition (AR) can improve classification accuracy, provide context regarding patient activity, and detect motion artifacts by identifying contractions that may result from patient movement. This work investigates the utility of including data from inertial measurement units (IMUs) in the classification pipeline, and considers various digital signal processing (DSP) and machine learning (ML) techniques for optimization and activity classification. In a case study, we analyze simultaneous bladder pressure and IMU data collected from an ambulating female Yucatan minipig. We identified 10 important, yet relatively inexpensive to compute signal features, with which we achieve an average 91.5% activity classification accuracy. Moreover, when classified activities are included in the bladder event analysis pipeline, we observe an improvement in classification accuracy, from 81% to 89.0%. These results suggest that certain IMU features can improve bladder event classification accuracy with low computational overhead.Clinical Relevance: This work establishes that activity recognition may be used in conjunction with single-channel bladder event detection systems to distinguish between contractions and motion artifacts for reducing the incorrect classification of bladder events. This is relevant for emerging sensors that measure intravesical pressure alone or for data analysis of bladder pressure in ambulatory subjects that contain significant abdominal pressure artifacts.

Asunto(s)

RESUMEN

Human activity recognition (HAR) is a crucial task in various applications, including healthcare, fitness, and the military. Deep learning models have revolutionized HAR, however, their computational complexity, particularly those involving BiLSTMs, poses significant challenges for deployment on resource-constrained devices like smartphones. While BiLSTMs effectively capture long-term dependencies by processing inputs bidirectionally, their high parameter count and computational demands hinder practical applications in real-time HAR. This study investigates the approximation of the computationally intensive BiLSTM component in a HAR model by using a combination of alternative model components and data flipping augmentation. The proposed modifications to an existing hybrid model architecture replace the BiLSTM with standard and residual LSTM, along with convolutional networks, supplemented by data flipping augmentation to replicate the context awareness typically provided by BiLSTM networks. The results demonstrate that the residual LSTM (ResLSTM) model achieves superior performance while maintaining a lower computational complexity compared to the traditional BiLSTM model. Specifically, on the UCI-HAR dataset, the ResLSTM model attains an accuracy of 96.34% with 576,702 parameters, outperforming the BiLSTM model's accuracy of 95.22% with 849,534 parameters. On the WISDM dataset, the ResLSTM achieves an accuracy of 97.20% with 192,238 parameters, compared to the BiLSTM's 97.23% accuracy with 283,182 parameters, demonstrating a more efficient architecture with minimal performance trade-off. For the KU-HAR dataset, the ResLSTM model achieves an accuracy of 97.05% with 386,038 parameters, showing comparable performance to the BiLSTM model's 98.63% accuracy with 569,462 parameters, but with significantly fewer parameters.

Asunto(s)

RESUMEN

This study introduces an innovative approach by incorporating statistical offset features, range profiles, time-frequency analyses, and azimuth-range-time characteristics to effectively identify various human daily activities. Our technique utilizes nine feature vectors consisting of six statistical offset features and three principal component analysis network (PCANet) fusion attributes. These statistical offset features are derived from combined elevation and azimuth data, considering their spatial angle relationships. The fusion attributes are generated through concurrent 1D networks using CNN-BiLSTM. The process begins with the temporal fusion of 3D range-azimuth-time data, followed by PCANet integration. Subsequently, a conventional classification model is employed to categorize a range of actions. Our methodology was tested with 21,000 samples across fourteen categories of human daily activities, demonstrating the effectiveness of our proposed solution. The experimental outcomes highlight the superior robustness of our method, particularly when using the Margenau-Hill Spectrogram for time-frequency analysis. When employing a random forest classifier, our approach outperformed other classifiers in terms of classification efficacy, achieving an average sensitivity, precision, F1, specificity, and accuracy of 98.25%, 98.25%, 98.25%, 99.87%, and 99.75%, respectively.

Asunto(s)

RESUMEN

Service-oriented organizational citizenship behavior refers to service workers' helping, cooperating, sharing, and donating actions that benefit others at a cost to themselves. Based on ethical climate theory, this research investigates whether corporations adopting environmental, social, and governance (ESG) management enhance service-oriented organizational citizenship behavior (SO OCB) among service employees. A total of 230 surveys were collected from call center workers in the insurance industry, and STATA 14.0 was used to analyze the 204 responses with useable data. The results show that employees' recognized ESG activities enable SO OCB through organizational commitment. Additionally, ESG activity recognition has a positive relationship with self-efficacy and empowerment, which helps service employees regulate external expectations. Thus, this finding is significant for call center workers experiencing emotional labor. Furthermore, the results suggest that firms can contribute to employees' SO OCB by practicing ESG activities. Firms should inform employees of their ESG management efforts as employees' recognition of an ethical climate can enhance their willingness to perform service-oriented behavior. Finally, ESG activity recognition can increase employees' organizational commitment, an important predictor of employee satisfaction and negative turnover rates.

RESUMEN

Human activity recognition has a wide range of applications in various fields, such as video surveillance, virtual reality and human-computer intelligent interaction. It has emerged as a significant research area in computer vision. GCN (Graph Convolutional networks) have recently been widely used in these fields and have made great performance. However, there are still some challenges including over-smoothing problem caused by stack graph convolutions and deficient semantics correlation to capture the large movements between time sequences. Vision Transformer (ViT) is utilized in many 2D and 3D image fields and has surprised results. In our work, we propose a novel human activity recognition method based on ViT (HAR-ViT). We integrate enhanced AGCL (eAGCL) in 2s-AGCN to ViT to make it process spatio-temporal data (3D skeleton) and make full use of spatial features. The position encoder module orders the non-sequenced information while the transformer encoder efficiently compresses sequence data features to enhance calculation speed. Human activity recognition is accomplished through multi-layer perceptron (MLP) classifier. Experimental results demonstrate that the proposed method achieves SOTA performance on three extensively used datasets, NTU RGB+D 60, NTU RGB+D 120 and Kinetics-Skeleton 400.

Asunto(s)

RESUMEN

The characterization of human behavior in real-world contexts is critical for developing a comprehensive model of human health. Recent technological advancements have enabled wearables and sensors to passively and unobtrusively record and presumably quantify human behavior. Better understanding human activities in unobtrusive and passive ways is an indispensable tool in understanding the relationship between behavioral determinants of health and diseases. Adult individuals (N = 60) emulated the behaviors of smoking, exercising, eating, and medication (pill) taking in a laboratory setting while equipped with smartwatches that captured accelerometer data. The collected data underwent expert annotation and was used to train a deep neural network integrating convolutional and long short-term memory architectures to effectively segment time series into discrete activities. An average macro-F1 score of at least 85.1 resulted from a rigorous leave-one-subject-out cross-validation procedure conducted across participants. The score indicates the method's high performance and potential for real-world applications, such as identifying health behaviors and informing strategies to influence health. Collectively, we demonstrated the potential of AI and its contributing role to healthcare during the early phases of diagnosis, prognosis, and/or intervention. From predictive analytics to personalized treatment plans, AI has the potential to assist healthcare professionals in making informed decisions, leading to more efficient and tailored patient care.

Asunto(s)

RESUMEN

Given the popularity of wrist-worn devices, particularly smartwatches, the identification of manual movement patterns has become of utmost interest within the research field of Human Activity Recognition (HAR) systems. In this context, by leveraging the numerous sensors natively embedded in smartwatches, the HAR functionalities that can be implemented in a watch via software and in a very cost-efficient way cover a wide variety of applications, ranging from fitness trackers to gesture detectors aimed at disabled individuals (e.g., for sending alarms), promoting behavioral activation or healthy lifestyle habits. In this regard, for the development of artificial intelligence algorithms capable of effectively discriminating these activities, it is of great importance to have repositories of movements that allow the scientific community to train, evaluate, and benchmark new proposals of movement detectors. The UMAHand dataset offers a collection of files containing the signals captured by a Shimmer 3 sensor node, which includes an accelerometer, a gyroscope, a magnetometer and a barometer, during the execution of different typical hand movements. For that purpose, the measurements from these four sensors, gathered at a sampling rate of 100 Hz, were taken from a group of 25 volunteers (16 females and 9 males), aged between 18 and 56, during the performance of 29 daily life activities involving hand mobility. Participants wore the sensor node on their dominant hand throughout the experiments.

RESUMEN

Human Activity Recognition (HAR) has emerged as a critical research area due to its extensive applications in various real-world domains. Numerous CSI-based datasets have been established to support the development and evaluation of advanced HAR algorithms. However, existing CSI-based HAR datasets are frequently limited by a dearth of complexity and diversity in the activities represented, hindering the design of robust HAR models. These limitations typically manifest as a narrow focus on a limited range of activities or the exclusion of factors influencing real-world CSI measurements. Consequently, the scarcity of diverse training data can impede the development of efficient HAR systems. To address the limitations of existing datasets, this paper introduces a novel dataset that captures spatial diversity through multiple transceiver orientations over a high dimensional space encompassing a large number of subcarriers. The dataset incorporates a wider range of real-world factors including extensive activity range, a spectrum of human movements (encompassing both micro-and macro-movements), variations in body composition, and diverse environmental conditions (noise and interference). The experiment is performed in a controlled laboratory environment with dimensions of 5 m (width) × 8 m (length) × 3 m (height) to capture CSI measurements for various human activities. Four ESP32-S3-DevKitC-1 devices, configured as transceiver pairs with unique Media Access Control (MAC) addresses, collect CSI data according to the Wi-Fi IEEE 802.11n standard. Mounted on tripods at a height of 1.5 m, the transmitter devices (powered by external power banks) positioned at north and east send multiple Wi-Fi beacons to their respective receivers (connected to laptops via USB for data collection) located at south and west. To capture multi-perspective CSI data, all six participants sequentially performed designated activities while standing in the centre of the tripod arrangement for 5 s per sample. The system collected approximately 300-450 packets per sample for approximately 1200 samples per activity, capturing CSI information across the 166 subcarriers employed in the Wi-Fi IEEE 802.11n standard. By leveraging the richness of this dataset, HAR researchers can develop more robust and generalizable CSI-based HAR models. Compared to traditional HAR approaches, these CSI-based models hold the promise of significantly enhanced accuracy and robustness when deployed in real-world scenarios. This stems from their ability to capture the nuanced dynamics of human movement through the analysis of wireless channel characteristic from different spatial variations (utilizing two-diagonal ESP32 transceivers configuration) with higher degree of dimensionality (166 subcarriers).

RESUMEN

Study objectives: To develop a non-invasive and practical wearable method for long-term tracking of infants' sleep. Methods: An infant wearable, NAPping PAnts (NAPPA), was constructed by combining a diaper cover and a movement sensor (triaxial accelerometer and gyroscope), allowing either real-time data streaming to mobile devices or offline feature computation stored in the sensor memory. A sleep state classifier (wake, N1/REM, N2/N3) was trained and tested for NAPPA recordings (N = 16649 epochs of 30 s), using hypnograms from co-registered polysomnography (PSG) as a training target in 33 infants (age 2 weeks to 18 months; Mean = 4). User experience was assessed from an additional group of 16 parents. Results: Overnight NAPPA recordings were successfully performed in all infants. The sleep state classifier showed good overall accuracy (78 %; Range 74-83 %) when using a combination of five features related to movement and respiration. Sleep depth trends were generated from the classifier outputs to visualise sleep state fluctuations, which closely aligned with PSG-derived hypnograms in all infants. Consistently positive parental feedback affirmed the effectiveness of the NAPPA-design. Conclusions: NAPPA offers a practical and feasible method for out-of-hospital assessment of infants' sleep behaviour. It can directly support large-scale quantitative studies and development of new paradigms in scientific research and infant healthcare. Moreover, NAPPA provides accurate and informative computational measures for body positions, respiration rates, and activity levels, each with their respective clinical and behavioural value.

RESUMEN

BACKGROUND: The more accurate we can assess human physical behaviour in free-living conditions the better we can understand its relationship with health and wellbeing. Thigh-worn accelerometry can be used to identify basic activity types as well as different postures with high accuracy. User-friendly software without the need for specialized programming may support the adoption of this method. This study aims to evaluate the classification accuracy of two novel no-code classification methods, namely SENS motion and ActiPASS. METHODS: A sample of 38 healthy adults (30.8 ± 9.6 years; 53% female) wore the SENS motion accelerometer (12.5 Hz; ±4 g) on their thigh during various physical activities. Participants completed standardized activities with varying intensities in the laboratory. Activities included walking, running, cycling, sitting, standing, and lying down. Subsequently, participants performed unrestricted free-living activities outside of the laboratory while being video-recorded with a chest-mounted camera. Videos were annotated using a predefined labelling scheme and annotations served as a reference for the free-living condition. Classification output from the SENS motion software and ActiPASS software was compared to reference labels. RESULTS: A total of 63.6 h of activity data were analysed. We observed a high level of agreement between the two classification algorithms and their respective references in both conditions. In the free-living condition, Cohen's kappa coefficients were 0.86 for SENS and 0.92 for ActiPASS. The mean balanced accuracy ranged from 0.81 (cycling) to 0.99 (running) for SENS and from 0.92 (walking) to 0.99 (sedentary) for ActiPASS across all activity types. CONCLUSIONS: The study shows that two available no-code classification methods can be used to accurately identify basic physical activity types and postures. Our results highlight the accuracy of both methods based on relatively low sampling frequency data. The classification methods showed differences in performance, with lower sensitivity observed in free-living cycling (SENS) and slow treadmill walking (ActiPASS). Both methods use different sets of activity classes with varying definitions, which may explain the observed differences. Our results support the use of the SENS motion system and both no-code classification methods.

Asunto(s)

RESUMEN

Activity recognition combined with artificial intelligence is a vital area of research, ranging across diverse domains, from sports and healthcare to smart homes. In the industrial domain, and the manual assembly lines, the emphasis shifts to human-machine interaction and thus to human activity recognition (HAR) within complex operational environments. Developing models and methods that can reliably and efficiently identify human activities, traditionally just categorized as either simple or complex activities, remains a key challenge in the field. Limitations of the existing methods and approaches include their inability to consider the contextual complexities associated with the performed activities. Our approach to address this challenge is to create different levels of activity abstractions, which allow for a more nuanced comprehension of activities and define their underlying patterns. Specifically, we propose a new hierarchical taxonomy for human activity abstraction levels based on the context of the performed activities that can be used in HAR. The proposed hierarchy consists of five levels, namely atomic, micro, meso, macro, and mega. We compare this taxonomy with other approaches that divide activities into simple and complex categories as well as other similar classification schemes and provide real-world examples in different applications to demonstrate its efficacy. Regarding advanced technologies like artificial intelligence, our study aims to guide and optimize industrial assembly procedures, particularly in uncontrolled non-laboratory environments, by shaping workflows to enable structured data analysis and highlighting correlations across various levels throughout the assembly progression. In addition, it establishes effective communication and shared understanding between researchers and industry professionals while also providing them with the essential resources to facilitate the development of systems, sensors, and algorithms for custom industrial use cases that adapt to the level of abstraction.

Asunto(s)

RESUMEN

Human activity recognition (HAR) is pivotal in advancing applications ranging from healthcare monitoring to interactive gaming. Traditional HAR systems, primarily relying on single data sources, face limitations in capturing the full spectrum of human activities. This study introduces a comprehensive approach to HAR by integrating two critical modalities: RGB imaging and advanced pose estimation features. Our methodology leverages the strengths of each modality to overcome the drawbacks of unimodal systems, providing a richer and more accurate representation of activities. We propose a two-stream network that processes skeletal and RGB data in parallel, enhanced by pose estimation techniques for refined feature extraction. The integration of these modalities is facilitated through advanced fusion algorithms, significantly improving recognition accuracy. Extensive experiments conducted on the UTD multimodal human action dataset (UTD MHAD) demonstrate that the proposed approach exceeds the performance of existing state-of-the-art algorithms, yielding improved outcomes. This study not only sets a new benchmark for HAR systems but also highlights the importance of feature engineering in capturing the complexity of human movements and the integration of optimal features. Our findings pave the way for more sophisticated, reliable, and applicable HAR systems in real-world scenarios.

Asunto(s)