RESUMEN

The Special Issue Sensors for Human Activity Recognition has received a total of 30 submissions so far, and from these, this new edition will publish 10 academic articles [...].

Asunto(s)

RESUMEN

Chronic spinal pain (CSP) is a prevalent condition, and prolonged sitting at work can contribute to it. Ergonomic factors like this can cause changes in motor variability. Variability analysis is a useful method to measure changes in motor performance over time. When performing the same task multiple times, different performance patterns can be observed. This variability is intrinsic to all biological systems and is noticeable in human movement. This study aims to examine whether changes in movement variability and complexity during real-time office work are influenced by CSP. The hypothesis is that individuals with and without pain will have different responses to office work tasks. Six office workers without pain and ten with CSP participated in this study. Participant's trunk movements were recorded during work for an entire week. Linear and nonlinear measures of trunk kinematic displacement were used to assess movement variability and complexity. A mixed ANOVA was utilized to compare changes in movement variability and complexity between the two groups. The effects indicate that pain-free participants showed more complex and less predictable trunk movements with a lower degree of structure and variability when compared to the participants suffering from CSP. The differences were particularly noticeable in fine movements.

Asunto(s)

RESUMEN

In this article we propose a conceptual framework to study ensembles of conformal predictors (CP), that we call Ensemble Predictors (EP). Our approach is inspired by the application of imprecise probabilities in information fusion. Based on the proposed framework, we study, for the first time in the literature, the theoretical properties of CP ensembles in a general setting, by focusing on simple and commonly used possibilistic combination rules. We also illustrate the applicability of the proposed methods in the setting of multivariate time-series classification, showing that these methods provide better performance (in terms of both robustness, conservativeness, accuracy and running time) than both standard classification algorithms and other combination rules proposed in the literature, on a large set of benchmarks from the UCR time series archive.

RESUMEN

Cardiac surgery patients are highly prone to severe complications post-discharge. Close follow-up through remote patient monitoring can help detect adverse outcomes earlier or prevent them, closing the gap between hospital and home care. However, equipment is limited due to economic and human resource constraints. This issue raises the need for efficient risk estimation to provide clinicians with insights into the potential benefit of remote monitoring for each patient. Standard models, such as the EuroSCORE, predict the mortality risk before the surgery. While these are used and validated in real settings, the models lack information collected during or following the surgery, determinant to predict adverse outcomes occurring further in the future. This paper proposes a Clinical Decision Support System based on Machine Learning to estimate the risk of severe complications within 90 days following cardiothoracic surgery discharge, an innovative objective underexplored in the literature. Health records from a cardiothoracic surgery department regarding 5 045 patients (60.8% male) collected throughout ten years were used to train predictive models. Clinicians' insights contributed to improving data preparation and extending traditional pipeline optimization techniques, addressing medical Artificial Intelligence requirements. Two separate test sets were used to evaluate the generalizability, one derived from a patient-grouped 70/30 split and another including all surgeries from the last available year. The achieved Area Under the Receiver Operating Characteristic curve on these test sets was 69.5% and 65.3%, respectively. Also, additional testing was implemented to simulate a real-world use case considering the weekly distribution of remote patient monitoring resources post-discharge. Compared to the random resource allocation, the selection of patients with respect to the outputs of the proposed model was proven beneficial, as it led to a higher number of high-risk patients receiving remote monitoring equipment.

Asunto(s)

RESUMEN

In this paper, we study human-AI collaboration protocols, a design-oriented construct aimed at establishing and evaluating how humans and AI can collaborate in cognitive tasks. We applied this construct in two user studies involving 12 specialist radiologists (the knee MRI study) and 44 ECG readers of varying expertise (the ECG study), who evaluated 240 and 20 cases, respectively, in different collaboration configurations. We confirm the utility of AI support but find that XAI can be associated with a "white-box paradox", producing a null or detrimental effect. We also find that the order of presentation matters: AI-first protocols are associated with higher diagnostic accuracy than human-first protocols, and with higher accuracy than both humans and AI alone. Our findings identify the best conditions for AI to augment human diagnostic skills, rather than trigger dysfunctional responses and cognitive biases that can undermine decision effectiveness.

Asunto(s)

RESUMEN

Occupational Health Protection (OHP) is mandatory by law and can be accomplished by considering the participation of others besides occupational physicians. The data shared can originate knowledge that might influence other processes related to occupational risk prevention. In this study, we used Artificial Intelligence (AI) methods to extract patterns among records shared under these circumstances over two years in the automotive industry. Records featuring OHP data against physical working conditions were selected, and a database of 383 profiles was designed. As Occupational Health Protection profiles under study are associated with work functional ability reduction, the body part(s) (n = 14) where it occurred were identified. Association Rules (ARs) coupled with Natural Language Processing techniques were applied to find meaningful hidden relationships and to identify the occurrence of protection profiles being assigned to at least two body parts simultaneously. After filtering ARs using three metrics (support, confidence, and lift), 54 ARs were found. The distribution of simultaneous body parts is presented as being higher in Special projects (n = 5). The results can use in: (i) design a multi-site body parts functional work ability (loss) model; (ii) model the capacity of organizations to retain workers in their working settings and (iii) prevent work-related musculoskeletal symptoms.

Asunto(s)

RESUMEN

Biosignal-based technology has been increasingly available in our daily life, being a critical information source. Wearable biosensors have been widely applied in, among others, biometrics, sports, health care, rehabilitation assistance, and edutainment. Continuous data collection from biodevices provides a valuable volume of information, which needs to be curated and prepared before serving machine learning applications. One of the universal preparation steps is data segmentation and labelling/annotation. This work proposes a practical and manageable way to automatically segment and label single-channel or multimodal biosignal data using a self-similarity matrix (SSM) computed with signals' feature-based representation. Applied to public biosignal datasets and a benchmark for change point detection, the proposed approach delivered lucid visual support in interpreting the biosignals with the SSM while performing accurate automatic segmentation of biosignals with the help of the novelty function and associating the segments grounded on their similarity measures with the similarity profiles. The proposed method performed superior to other algorithms in most cases of a series of automatic biosignal segmentation tasks; of equal appeal is that it provides an intuitive visualization for information retrieval of multimodal biosignals.

Asunto(s)

RESUMEN

Human Activity Recognition (HAR) has been studied extensively, yet current approaches are not capable of generalizing across different domains (i.e., subjects, devices, or datasets) with acceptable performance. This lack of generalization hinders the applicability of these models in real-world environments. As deep neural networks are becoming increasingly popular in recent work, there is a need for an explicit comparison between handcrafted and deep representations in Out-of-Distribution (OOD) settings. This paper compares both approaches in multiple domains using homogenized public datasets. First, we compare several metrics to validate three different OOD settings. In our main experiments, we then verify that even though deep learning initially outperforms models with handcrafted features, the situation is reversed as the distance from the training distribution increases. These findings support the hypothesis that handcrafted features may generalize better across specific domains.

Asunto(s)

RESUMEN

In automotive and industrial settings, occupational physicians are responsible for monitoring workers' health protection profiles. Workers' Functional Work Ability (FWA) status is used to create Occupational Health Protection Profiles (OHPP). This is a novel longitudinal study in comparison with previous research that has predominantly relied on the causality and explainability of human-understandable models for industrial technical teams like ergonomists. The application of artificial intelligence can support the decision-making to go from a worker's Functional Work Ability to explanations by integrating explainability into medical (restriction) and support in contexts of individual, work-related, and organizational risk conditions. A sample of 7857 for the prognosis part of OHPP based on Functional Work Ability in the Portuguese language in the automotive industry was taken from 2019 to 2021. The most suitable regression models to predict the next medical appointment for the workers' body parts protection were the models based on CatBoost regression, with an RMSLE of 0.84 and 1.23 weeks (mean error), respectively. CatBoost algorithm is also used to predict the next body part severity of OHPP. This information can help our understanding of potential risk factors for OHPP and identify warning signs of the early stages of musculoskeletal symptoms and work-related absenteeism.

Asunto(s)

RESUMEN

Wearable sensors have increasingly been applied in healthcare to generate data and monitor patients unobtrusively. Their application for Brain-Computer Interfaces (BCI) allows for unobtrusively monitoring one's cognitive state over time. A particular state relevant in multiple domains is cognitive fatigue, which may impact performance and attention, among other capabilities. The monitoring of this state will be applied in real learning settings to detect and advise on effective break periods. In this study, two functional near-infrared spectroscopy (fNIRS) wearable devices were employed to build a BCI to automatically detect the state of cognitive fatigue using machine learning algorithms. An experimental procedure was developed to effectively induce cognitive fatigue that included a close-to-real digital lesson and two standard cognitive tasks: Corsi-Block task and a concentration task. Machine learning models were user-tuned to account for the individual dynamics of each participant, reaching classification accuracy scores of around 70.91 ± 13.67 %. We concluded that, although effective for some subjects, the methodology needs to be individually validated before being applied. Moreover, time on task was not a particularly determining factor for classification, i.e., to induce cognitive fatigue. Further research will include other physiological signals and human-computer interaction variables.

Asunto(s)

RESUMEN

Cumulative fatigue during repetitive work is associated with occupational risk and productivity reduction. Usually, subjective measures or muscle activity are used for a cumulative evaluation; however, Industry 4.0 wearables allow overcoming the challenges observed in those methods. Thus, the aim of this study is to analyze alterations in respiratory inductance plethysmography (RIP) to measure the asynchrony between thorax and abdomen walls during repetitive work and its relationship with local fatigue. A total of 22 healthy participants (age: 27.0 ± 8.3 yrs; height: 1.72 ± 0.09 m; mass: 63.4 ± 12.9 kg) were recruited to perform a task that includes grabbing, moving, and placing a box in an upper and lower shelf. This task was repeated for 10 min in three trials with a fatigue protocol between them. Significant main effects were found from Baseline trial to the Fatigue trials (p < 0.001) for both RIP correlation and phase synchrony. Similar results were found for the activation amplitude of agonist muscle (p < 0.001), and to the muscle acting mainly as a joint stabilizer (p < 0.001). The latter showed a significant effect in predicting both RIP correlation and phase synchronization. Both RIP correlation and phase synchronization can be used for an overall fatigue assessment during repetitive work.

Asunto(s)

RESUMEN

Job rotation is a work organization strategy with increasing popularity, given its benefits for workers and companies, especially those working with manufacturing. This study proposes a formulation to help the team leader in an assembly line of the automotive industry to achieve job rotation schedules based on three major criteria: improve diversity, ensure homogeneity, and thus reduce exposure level. The formulation relied on a genetic algorithm, that took into consideration the biomechanical risk factors (EAWS), workers' qualifications, and the organizational aspects of the assembly line. Moreover, the job rotation plan formulated by the genetic algorithm formulation was compared with the solution provided by the team leader in a real life-environment. The formulation proved to be a reliable solution to design job rotation plans for increasing diversity, decreasing exposure, and balancing homogeneity within workers, achieving better results in all of the outcomes when compared with the job rotation schedules created by the team leader. Additionally, this solution was less time-consuming for the team leader than a manual implementation. This study provides a much-needed solution to the job rotation issue in the manufacturing industry, with the genetic algorithm taking less time and showing better results than the job rotations created by the team leaders.

RESUMEN

Human activity recognition (HAR) and human behavior recognition (HBR) have been playing increasingly important roles in the digital age [...].

Asunto(s)

RESUMEN

With the fast increase in the demand for location-based services and the proliferation of smartphones, the topic of indoor localization is attracting great interest. In indoor environments, users' performed activities carry useful semantic information. These activities can then be used by indoor localization systems to confirm users' current relative locations in a building. In this paper, we propose a deep-learning model based on a Convolutional Long Short-Term Memory (ConvLSTM) network to classify human activities within the indoor localization scenario using smartphone inertial sensor data. Results show that the proposed human activity recognition (HAR) model accurately identifies nine types of activities: not moving, walking, running, going up in an elevator, going down in an elevator, walking upstairs, walking downstairs, or going up and down a ramp. Moreover, predicted human activities were integrated within an existing indoor positioning system and evaluated in a multi-story building across several testing routes, with an average positioning error of 2.4 m. The results show that the inclusion of human activity information can reduce the overall localization error of the system and actively contribute to the better identification of floor transitions within a building. The conducted experiments demonstrated promising results and verified the effectiveness of using human activity-related information for indoor localization.

Asunto(s)

RESUMEN

OBJECTIVES: To investigate the use of a set of dynamical features, extracted from surface electromyography, to study upper motor neuron (UMN) degeneration in amyotrophic lateral sclerosis (ALS). METHODS: We acquired surface EMG signals from the upper limb muscles of 13 ALS patients and 20 control subjects and classified them according to a novel set of muscle activity features, describing the temporal and frequency dynamic behavior of the signals, as well as measures of its complexity. Using a battery of classification approaches, we searched for the most discriminating combination of those features, as well as a suitable strategy to identify ALS. RESULTS: We observed significant differences between ALS patients and controls, in particular when considering features highlighting differences between forearm and hand recordings, for which classification accuracies of up to 94% were achieved. The most robust discriminations were achieved using features based on detrended fluctuation analysis and peak frequency, and classifiers such as decision trees, random forest and Adaboost. CONCLUSION: The current work shows that it is possible to achieve good identification of UMN changes in ALS by taking into consideration the dynamical behavior of surface electromyographic (sEMG) data.

Asunto(s)

RESUMEN

Treatment and prevention of cardiovascular diseases often rely on Electrocardiogram (ECG) interpretation. Dependent on the physician's variability, ECG interpretation is subjective and prone to errors. Machine learning models are often developed and used to support doctors; however, their lack of interpretability stands as one of the main drawbacks of their widespread operation. This paper focuses on an Explainable Artificial Intelligence (XAI) solution to make heartbeat classification more explainable using several state-of-the-art model-agnostic methods. We introduce a high-level conceptual framework for explainable time series and propose an original method that adds temporal dependency between time samples using the time series' derivative. The results were validated in the MIT-BIH arrhythmia dataset: we performed a performance's analysis to evaluate whether the explanations fit the model's behaviour; and employed the 1-D Jaccard's index to compare the subsequences extracted from an interpretable model and the XAI methods used. Our results show that the use of the raw signal and its derivative includes temporal dependency between samples to promote classification explanation. A small but informative user study concludes this study to evaluate the potential of the visual explanations produced by our original method for being adopted in real-world clinical settings, either as diagnostic aids or training resource.

Asunto(s)

RESUMEN

Pointer-tracking methods can capture a real-time trace at high spatio-temporal resolution of users' pointer interactions with a graphical user interface. This trace is potentially valuable for research on human-computer interaction (HCI) and for investigating perceptual, cognitive and affective processes during HCI. However, little research has reported spatio-temporal pointer features for the purpose of tracking pointer movements in on-line surveys. In two studies, we identified a set of pointer features and movement patterns and showed that these can be easily distinguished. In a third study, we explored the feasibility of using patterns of interactive pointer movements, or micro-behaviours, to detect response uncertainty. Using logistic regression and k-fold cross-validation in model training and testing, the uncertainty model achieved an estimated performance accuracy of 81%. These findings suggest that micro-behaviours provide a promising approach toward developing a better understanding of the relationship between the dynamics of pointer movements and underlying perceptual, cognitive and affective psychological mechanisms.

RESUMEN

Infrastructure-free Indoor Positioning Systems (IPS) are becoming popular due to their scalability and a wide range of applications. Such systems often rely on deployed Wi-Fi networks. However, their usability may be compromised, either due to scanning restrictions from recent Android versions or the proliferation of 5G technology. This raises the need for new infrastructure-free IPS independent of Wi-Fi networks. In this paper, we propose the use of magnetic field data for IPS, through Deep Neural Networks (DNN). Firstly, a dataset of human indoor trajectories was collected with different smartphones. Afterwards, a magnetic fingerprint was constructed and relevant features were extracted to train a DNN that returns a probability map of a user's location. Finally, two postprocessing methods were applied to obtain the most probable location regions. We asserted the performance of our solution against a test dataset, which produced a Success Rate of around 80%. We believe that these results are competitive for an IPS based on a single sensing source. Moreover, the magnetic field can be used as an additional information layer to increase the robustness and redundancy of current multi-source IPS.

RESUMEN

Research in the use of ubiquitous technologies, tracking systems and wearables within mental health domains is on the rise. In recent years, affective technologies have gained traction and garnered the interest of interdisciplinary fields as the research on such technologies matured. However, while the role of movement and bodily experience to affective experience is well-established, how to best address movement and engagement beyond measuring cues and signals in technology-driven interactions has been unclear. In a joint industry-academia effort, we aim to remodel how affective technologies can help address body and emotional self-awareness. We present an overview of biosignals that have become standard in low-cost physiological monitoring and show how these can be matched with methods and engagements used by interaction designers skilled in designing for bodily engagement and aesthetic experiences. Taking both strands of work together offers unprecedented design opportunities that inspire further research. Through first-person soma design, an approach that draws upon the designer's felt experience and puts the sentient body at the forefront, we outline a comprehensive work for the creation of novel interactions in the form of couplings that combine biosensing and body feedback modalities of relevance to affective health. These couplings lie within the creation of design toolkits that have the potential to render rich embodied interactions to the designer/user. As a result we introduce the concept of "orchestration". By orchestration, we refer to the design of the overall interaction: coupling sensors to actuation of relevance to the affective experience; initiating and closing the interaction; habituating; helping improve on the users' body awareness and engagement with emotional experiences; soothing, calming, or energising, depending on the affective health condition and the intentions of the designer. Through the creation of a range of prototypes and couplings we elicited requirements on broader orchestration mechanisms. First-person soma design lets researchers look afresh at biosignals that, when experienced through the body, are called to reshape affective technologies with novel ways to interpret biodata, feel it, understand it and reflect upon our bodies.

Asunto(s)

RESUMEN

The field of biometrics is a pattern recognition problem, where the individual traits are coded, registered, and compared with other database records. Due to the difficulties in reproducing Electrocardiograms (ECG), their usage has been emerging in the biometric field for more secure applications. Inspired by the high performance shown by Deep Neural Networks (DNN) and to mitigate the intra-variability challenges displayed by the ECG of each individual, this work proposes two architectures to improve current results in both identification (finding the registered person from a sample) and authentication (prove that the person is whom it claims) processes: Temporal Convolutional Neural Network (TCNN) and Recurrent Neural Network (RNN). Each architecture produces a similarity score, based on the prediction error of the former and the logits given by the last, and fed to the same classifier, the Relative Score Threshold Classifier (RSTC).The robustness and applicability of these architectures were trained and tested on public databases used by literature in this context: Fantasia, MIT-BIH, and CYBHi databases. Results show that overall the TCNN outperforms the RNN achieving almost 100%, 96%, and 90% accuracy, respectively, for identification and 0.0%, 0.1%, and 2.2% equal error rate (EER) for authentication processes. When comparing to previous work, both architectures reached results beyond the state-of-the-art. Nevertheless, the improvement of these techniques, such as enriching training with extra varied data and transfer learning, may provide more robust systems with a reduced time required for validation.

Asunto(s)