RESUMEN
Ovarian tumors, especially malignant ones, represent a global concern, with increased prevalence in recent years. More accurate medical support systems are urgently needed to support medical staff in obtaining an efficient ovarian tumors diagnosis since detection in early stages could lead to immediately applying appropriate treatment, and implicitly improving the survival rate. The current paper aims to demonstrate that more accurate systems could be designed by combining different convolutional neural networks using different custom combination approaches and by selecting the appropriate networks to be involved in the ensemble model to achieve the best performance metrics. It is essential to understand if combining all experimented networks or only the best-performing ones could always lead to the most effective results or not. The current paper is structured in three main phases. The first step is to propose the individual networks involved in the experiments. Five DeepLab-V3+ networks with different encoders (ResNet-18, ResNet-50, MobileNet-V2, InceptionResNet-V2, and Xception) were used. In the second step, the paper proposes a custom algorithm to combine multiple individual semantic segmentation networks, while the last step describes the iterative selection approach for selecting all individual networks to be combined so that the most accurate ensemble is obtained. The system performing semantic segmentation for different types of ovarian tumors, covering both benign and malignant ones, achieved 91.18 % Intersection over union (IoU), thus overperforming all individual networks. The proposed method could be extended so that more powerful deep learning models could be used.
RESUMEN
Orchard monitoring is a vital direction of scientific research and practical application for increasing fruit production in ecological conditions. Recently, due to the development of technology and the decrease in equipment cost, the use of unmanned aerial vehicles and artificial intelligence algorithms for image acquisition and processing has achieved tremendous progress in orchards monitoring. This paper highlights the new research trends in orchard monitoring, emphasizing neural networks, unmanned aerial vehicles (UAVs), and various concrete applications. For this purpose, papers on complex topics obtained by combining keywords from the field addressed were selected and analyzed. In particular, the review considered papers on the interval 2017-2022 on the use of neural networks (as an important exponent of artificial intelligence in image processing and understanding) and UAVs in orchard monitoring and production evaluation applications. Due to their complexity, the characteristics of UAV trajectories and flights in the orchard area were highlighted. The structure and implementations of the latest neural network systems used in such applications, the databases, the software, and the obtained performances are systematically analyzed. To recommend some suggestions for researchers and end users, the use of the new concepts and their implementations were surveyed in concrete applications, such as a) identification and segmentation of orchards, trees, and crowns; b) detection of tree diseases, harmful insects, and pests; c) evaluation of fruit production, and d) evaluation of development conditions. To show the necessity of this review, in the end, a comparison is made with review articles with a related theme.
RESUMEN
Modern and precision agriculture is constantly evolving, and the use of technology has become a critical factor in improving crop yields and protecting plants from harmful insects and pests. The use of neural networks is emerging as a new trend in modern agriculture that enables machines to learn and recognize patterns in data. In recent years, researchers and industry experts have been exploring the use of neural networks for detecting harmful insects and pests in crops, allowing farmers to act and mitigate damage. This paper provides an overview of new trends in modern agriculture for harmful insect and pest detection using neural networks. Using a systematic review, the benefits and challenges of this technology are highlighted, as well as various techniques being taken by researchers to improve its effectiveness. Specifically, the review focuses on the use of an ensemble of neural networks, pest databases, modern software, and innovative modified architectures for pest detection. The review is based on the analysis of multiple research papers published between 2015 and 2022, with the analysis of the new trends conducted between 2020 and 2022. The study concludes by emphasizing the significance of ongoing research and development of neural network-based pest detection systems to maintain sustainable and efficient agricultural production.
RESUMEN
Today, skin cancer, and especially melanoma, is an increasing and dangerous health disease. The high mortality rate of some types of skin cancers needs to be detected in the early stages and treated urgently. The use of neural network ensembles for the detection of objects of interest in images has gained more and more interest due to the increased performance of the results. In this sense, this paper proposes two ensembles of neural networks, based on the fusion of the decisions of the component neural networks for the detection of four skin lesions (basal cancer cell, melanoma, benign keratosis, and melanocytic nevi). The first system is based on separate learning of three neural networks (MobileNet V2, DenseNet 169, and EfficientNet B2), with multiple weights for the four classes of lesions and weighted overall prediction. The second system is made up of six binary models (one for each pair of classes) for each network; the fusion and prediction are conducted by weighted summation per class and per model. In total, 18 such binary models will be considered. The 91.04% global accuracy of this set of binary models is superior to the first system (89.62%). Separately, only for the binary classifications within the system was the individual accuracy better. The individual F1 score for each class and the global system varied from 81.36% to 94.17%. Finally, a critical comparison is made with similar works from the literature.
RESUMEN
Facial emotion recognition (FER) is a computer vision process aimed at detecting and classifying human emotional expressions. FER systems are currently used in a vast range of applications from areas such as education, healthcare, or public safety; therefore, detection and recognition accuracies are very important. Similar to any computer vision task based on image analyses, FER solutions are also suitable for integration with artificial intelligence solutions represented by different neural network varieties, especially deep neural networks that have shown great potential in the last years due to their feature extraction capabilities and computational efficiency over large datasets. In this context, this paper reviews the latest developments in the FER area, with a focus on recent neural network models that implement specific facial image analysis algorithms to detect and recognize facial emotions. This paper's scope is to present from historical and conceptual perspectives the evolution of the neural network architectures that proved significant results in the FER area. This paper endorses convolutional neural network (CNN)-based architectures against other neural network architectures, such as recurrent neural networks or generative adversarial networks, highlighting the key elements and performance of each architecture, and the advantages and limitations of the proposed models in the analyzed papers. Additionally, this paper presents the available datasets that are currently used for emotion recognition from facial expressions and micro-expressions. The usage of FER systems is also highlighted in various domains such as healthcare, education, security, or social IoT. Finally, open issues and future possible developments in the FER area are identified.
Asunto(s)
Inteligencia Artificial , Redes Neurales de la Computación , Humanos , Algoritmos , Emociones , CaraRESUMEN
Accurate quantification of left atrium (LA) scar in patients with atrial fibrillation is essential to guide successful ablation strategies. Prior to LA scar quantification, a proper LA cavity segmentation is required to ensure exact location of scar. Both tasks can be extremely time-consuming and are subject to inter-observer disagreements when done manually. We developed and validated a deep neural network to automatically segment the LA cavity and the LA scar. The global architecture uses a multi-network sequential approach in two stages which segment the LA cavity and the LA Scar. Each stage has two steps: a region of interest Neural Network and a refined segmentation network. We analysed the performances of our network according to different parameters and applied data triaging. 200+ late gadolinium enhancement magnetic resonance images were provided by the LAScarQS 2022 Challenge. Finally, we compared our performances for scar quantification to the literature and demonstrated improved performances.
RESUMEN
Given its essential role in body functions, liver cancer is the third most common cause of death from cancer, despite being the sixth most common type of cancer worldwide. Following advancements in medicine and image processing, medical image segmentation methods are receiving a great deal of attention. As a novelty, the paper proposes an intelligent decision system for segmenting liver and hepatic tumors by integrating four efficient neural networks (ResNet152, ResNeXt101, DenseNet201, and InceptionV3). Images from computed tomography for training, validation, and testing were taken from the public LiTS17 database and preprocessed to better highlight liver tissue and tumors. Global segmentation is done by separately training individual classifiers and the global system of merging individual decisions. For the aforementioned application, classification neural networks have been modified for semantic segmentation. After segmentation based on the neural network system, the images were postprocessed to eliminate artifacts. The segmentation results obtained by the system were better, from the point of view of the Dice coefficient, than those obtained by the individual networks, and comparable with those reported in recent works.
RESUMEN
Squamous cell carcinoma of the head and neck (HNSCC) is a common malignancy often diagnosed in the advanced stage with a complex negative influence on the patient's quality of life (QoL). Given its multi-modal treatment, the first step is to adequately balance the needs of the patient, and the second step includes the consultations, interventions, and care provided by the medical team, with the purpose of improving the overall management of the HNSCC. Current attempts to develop and validate quality-of-life instruments specific to cancers of the head and neck have been reported, and certain questionnaires are now available. We performed a retrospective study in a tertiary centre, involving 89 patients who survived 3 years after HNSCC surgery. A patient-related outcome measurement was made using the European Organization for Research and Treatment of Cancer (EORTC) QLQ-C30 and QLQ-H&N35 instruments to assess QoL at admission and 3 years after treatment. The 3-year survivors reported an overall improvement in QoL compared with those in the pre-treatment period. The unique details of head and neck cancer treatments outline the importance of considering the characteristics of the patient population in quality-of-life research and also identify how quality-of-life data can contribute to the care provided by the multi-disciplinary team involved in a patient's follow-up.
RESUMEN
Skin lesion detection and analysis are very important because skin cancer must be found in its early stages and treated immediately. Once installed in the body, skin cancer can easily spread to other body parts. Early detection would represent a very important aspect since, by ensuring correct treatment, it could be curable. Thus, by taking all these issues into consideration, there is a need for highly accurate computer-aided systems to assist medical staff in the early detection of malignant skin lesions. In this paper, we propose a skin lesion classification system based on deep learning techniques and collective intelligence, which involves multiple convolutional neural networks, trained on the HAM10000 dataset, which is able to predict seven skin lesions including melanoma. The convolutional neural networks experimentally chosen, considering their performances, to implement the collective intelligence-based system for this purpose are: AlexNet, GoogLeNet, GoogLeNet-Places365, MobileNet-V2, Xception, ResNet-50, ResNet-101, InceptionResNet-V2 and DenseNet201. We then analyzed the performances of each of the above-mentioned convolutional neural networks to obtain a weight matrix whose elements are weights associated with neural networks and classes of lesions. Based on this matrix, a new decision matrix was used to build the multi-network ensemble system (Collective Intelligence-based System), combining each of individual neural network decision into a decision fusion module (Collective Decision Block). This module would then have the responsibility to take a final and more accurate decision related to the prediction based on the associated weights of each network output. The validation accuracy of the proposed system is about 3 percent better than that of the best performing individual network.
Asunto(s)
Melanoma , Enfermedades de la Piel , Neoplasias Cutáneas , Humanos , Inteligencia , Melanoma/diagnóstico , Redes Neurales de la Computación , Neoplasias Cutáneas/diagnósticoRESUMEN
Background: COVID-19 infection carries significant morbidity and mortality. Current risk prediction for complications in COVID-19 is limited, and existing approaches fail to account for the dynamic course of the disease. Objectives: The purpose of this study was to develop and validate the COVID-HEART predictor, a novel continuously updating risk-prediction technology to forecast adverse events in hospitalized patients with COVID-19. Methods: Retrospective registry data from patients with severe acute respiratory syndrome coronavirus 2 infection admitted to 5 hospitals were used to train COVID-HEART to predict all-cause mortality/cardiac arrest (AM/CA) and imaging-confirmed thromboembolic events (TEs) (n = 2,550 and n = 1,854, respectively). To assess COVID-HEART's performance in the face of rapidly changing clinical treatment guidelines, an additional 1,100 and 796 patients, admitted after the completion of development data collection, were used for testing. Leave-hospital-out validation was performed. Results: Over 20 iterations of temporally divided testing, the mean area under the receiver operating characteristic curve were 0.917 (95% confidence interval [CI]: 0.916-0.919) and 0.757 (95% CI: 0.751-0.763) for prediction of AM/CA and TE, respectively. The interquartile ranges of median early warning times were 14 to 21 hours for AM/CA and 12 to 60 hours for TE. The mean area under the receiver operating characteristic curve for the left-out hospitals were 0.956 (95% CI: 0.936-0.976) and 0.781 (95% CI: 0.642-0.919) for prediction of AM/CA and TE, respectively. Conclusions: The continuously updating, fully interpretable COVID-HEART predictor accurately predicts AM/CA and TE within multiple time windows in hospitalized COVID-19 patients. In its current implementation, the predictor can facilitate practical, meaningful changes in patient triage and resource allocation by providing real-time risk scores for these outcomes. The potential utility of the predictor extends to COVID-19 patients after hospitalization and beyond COVID-19.
RESUMEN
Sudden cardiac death from arrhythmia is a major cause of mortality worldwide. Here, we develop a novel deep learning (DL) approach that blends neural networks and survival analysis to predict patient-specific survival curves from contrast-enhanced cardiac magnetic resonance images and clinical covariates for patients with ischemic heart disease. The DL-predicted survival curves offer accurate predictions at times up to 10 years and allow for estimation of uncertainty in predictions. The performance of this learning architecture was evaluated on multi-center internal validation data and tested on an independent test set, achieving concordance index of 0.83 and 0.74, and 10-year integrated Brier score of 0.12 and 0.14. We demonstrate that our DL approach with only raw cardiac images as input outperforms standard survival models constructed using clinical covariates. This technology has the potential to transform clinical decision-making by offering accurate and generalizable predictions of patient-specific survival probabilities of arrhythmic death over time.
RESUMEN
Background: Visualizing fibrosis on cardiac magnetic resonance (CMR) imaging with contrast enhancement (late gadolinium enhancement; LGE) is paramount in characterizing disease progression and identifying arrhythmia substrates. Segmentation and fibrosis quantification from LGE-CMR is intensive, manual, and prone to interobserver variability. There is an unmet need for automated LGE-CMR image segmentation that ensures anatomical accuracy and seamless extraction of clinical features. Objective: This study aimed to develop a novel deep learning solution for analysis of contrast-enhanced CMR images that produces anatomically accurate myocardium and scar/fibrosis segmentations and uses these to calculate features of clinical interest. Methods: Data sources were 155 2-dimensional LGE-CMR patient scans (1124 slices) and 246 synthetic "LGE-like" scans (1360 slices) obtained from cine CMR using a novel style-transfer algorithm. We trained and tested a 3-stage neural network that identified the left ventricle (LV) region of interest (ROI), segmented ROI into viable myocardium and regions of enhancement, and postprocessed the segmentation results to enforce conforming to anatomical constraints. The segmentations were used to directly compute clinical features, such as LV volume and scar burden. Results: Predicted LV and scar segmentations achieved 96% and 75% balanced accuracy, respectively, and 0.93 and 0.57 Dice coefficient when compared to trained expert segmentations. The mean scar burden difference between manual and predicted segmentations was 2%. Conclusion: We developed and validated a deep neural network for automatic, anatomically accurate expert-level LGE- CMR myocardium and scar/fibrosis segmentation, allowing direct calculation of clinical measures. Given the training set heterogeneity, our approach could be extended to multiple imaging modalities and patient pathologies.
RESUMEN
Due to its increasing incidence, skin cancer, and especially melanoma, is a serious health disease today. The high mortality rate associated with melanoma makes it necessary to detect the early stages to be treated urgently and properly. This is the reason why many researchers in this domain wanted to obtain accurate computer-aided diagnosis systems to assist in the early detection and diagnosis of such diseases. The paper presents a systematic review of recent advances in an area of increased interest for cancer prediction, with a focus on a comparative perspective of melanoma detection using artificial intelligence, especially neural network-based systems. Such structures can be considered intelligent support systems for dermatologists. Theoretical and applied contributions were investigated in the new development trends of multiple neural network architecture, based on decision fusion. The most representative articles covering the area of melanoma detection based on neural networks, published in journals and impact conferences, were investigated between 2015 and 2021, focusing on the interval 2018-2021 as new trends. Additionally presented are the main databases and trends in their use in teaching neural networks to detect melanomas. Finally, a research agenda was highlighted to advance the field towards the new trends.
Asunto(s)
Aprendizaje Profundo , Melanoma , Neoplasias Cutáneas , Inteligencia Artificial , Humanos , Melanoma/diagnóstico , Redes Neurales de la Computación , Neoplasias Cutáneas/diagnósticoRESUMEN
Cardiac sarcoidosis (CS), an inflammatory disease characterized by formation of granulomas in the heart, is associated with high risk of sudden cardiac death (SCD) from ventricular arrhythmias. Current "one-size-fits-all" guidelines for SCD risk assessment in CS result in insufficient appropriate primary prevention. Here, we present a two-step precision risk prediction technology for patients with CS. First, a patient's arrhythmogenic propensity arising from heterogeneous CS-induced ventricular remodeling is assessed using a novel personalized magnetic-resonance imaging and positron-emission tomography fusion mechanistic model. The resulting simulations of arrhythmogenesis are fed, together with a set of imaging and clinical biomarkers, into a supervised classifier. In a retrospective study of 45 patients, the technology achieved testing results of 60% sensitivity [95% confidence interval (CI): 57-63%], 72% specificity [95% CI: 70-74%], and 0.754 area under the receiver operating characteristic curve [95% CI: 0.710-0.797]. It outperformed clinical metrics, highlighting its potential to transform CS risk stratification.
Asunto(s)
Cardiomiopatías , Sarcoidosis , Arritmias Cardíacas , Cardiomiopatías/diagnóstico , Cardiomiopatías/etiología , Muerte Súbita Cardíaca/etiología , Muerte Súbita Cardíaca/prevención & control , Humanos , Estudios Retrospectivos , Medición de Riesgo , Sarcoidosis/complicaciones , Sarcoidosis/diagnósticoRESUMEN
This editorial article briefly outlines the objectives and achieved goals of the Special Issue on "Convergence of Intelligent Data Acquisition and Advanced Computing Systems" running between September 2019 and September 2020 in the Sensors journal [...].
RESUMEN
Machine learning (ML), a branch of artificial intelligence, where machines learn from big data, is at the crest of a technological wave of change sweeping society. Cardiovascular medicine is at the forefront of many ML applications, and there is a significant effort to bring them into mainstream clinical practice. In the field of cardiac electrophysiology, ML applications have also seen a rapid growth and popularity, particularly the use of ML in the automatic interpretation of ECGs, which has been extensively covered in the literature. Much lesser known are the other aspects of ML application in cardiac electrophysiology and arrhythmias, such as those in basic science research on arrhythmia mechanisms, both experimental and computational; in the development of better techniques for mapping of cardiac electrical function; and in translational research related to arrhythmia management. In the current review, we examine comprehensively such ML applications as they match the scope of this journal. The current review is organized in 3 parts. The first provides an overview of general ML principles and methodologies that will afford readers of the necessary information on the subject, serving as the foundation for inviting further ML applications in arrhythmia research. The basic information we provide can serve as a guide on how one might design and conduct an ML study. The second part is a review of arrhythmia and electrophysiology studies in which ML has been utilized, highlighting the broad potential of ML approaches. For each subject, we outline comprehensively the general topics, while reviewing some of the research advances utilizing ML under the subject. Finally, we discuss the main challenges and the perspectives for ML-driven cardiac electrophysiology and arrhythmia research.
Asunto(s)
Arritmias Cardíacas/fisiopatología , Técnicas Electrofisiológicas Cardíacas/métodos , Aprendizaje Automático , Animales , Arritmias Cardíacas/diagnóstico , Arritmias Cardíacas/terapia , Sistemas de Apoyo a Decisiones Clínicas , Humanos , Modelos CardiovascularesRESUMEN
BACKGROUND: Pulmonary vein isolation (PVI) is an effective treatment strategy for patients with atrial fibrillation (AF), but many experience AF recurrence and require repeat ablation procedures. The goal of this study was to develop and evaluate a methodology that combines machine learning (ML) and personalized computational modeling to predict, before PVI, which patients are most likely to experience AF recurrence after PVI. METHODS: This single-center retrospective proof-of-concept study included 32 patients with documented paroxysmal AF who underwent PVI and had preprocedural late gadolinium enhanced magnetic resonance imaging. For each patient, a personalized computational model of the left atrium simulated AF induction via rapid pacing. Features were derived from pre-PVI late gadolinium enhanced magnetic resonance images and from results of simulations of AF induction. The most predictive features were used as input to a quadratic discriminant analysis ML classifier, which was trained, optimized, and evaluated with 10-fold nested cross-validation to predict the probability of AF recurrence post-PVI. RESULTS: In our cohort, the ML classifier predicted probability of AF recurrence with an average validation sensitivity and specificity of 82% and 89%, respectively, and a validation area under the curve of 0.82. Dissecting the relative contributions of simulations of AF induction and raw images to the predictive capability of the ML classifier, we found that when only features from simulations of AF induction were used to train the ML classifier, its performance remained similar (validation area under the curve, 0.81). However, when only features extracted from raw images were used for training, the validation area under the curve significantly decreased (0.47). CONCLUSIONS: ML and personalized computational modeling can be used together to accurately predict, using only pre-PVI late gadolinium enhanced magnetic resonance imaging scans as input, whether a patient is likely to experience AF recurrence following PVI, even when the patient cohort is small.
Asunto(s)
Fibrilación Atrial/cirugía , Ablación por Catéter/efectos adversos , Diagnóstico por Computador , Aprendizaje Automático , Imagen por Resonancia Magnética , Modelos Cardiovasculares , Modelación Específica para el Paciente , Venas Pulmonares/cirugía , Potenciales de Acción , Anciano , Fibrilación Atrial/diagnóstico por imagen , Fibrilación Atrial/fisiopatología , Medios de Contraste/administración & dosificación , Femenino , Frecuencia Cardíaca , Humanos , Masculino , Meglumina/administración & dosificación , Meglumina/análogos & derivados , Persona de Mediana Edad , Compuestos Organometálicos/administración & dosificación , Valor Predictivo de las Pruebas , Prueba de Estudio Conceptual , Venas Pulmonares/diagnóstico por imagen , Venas Pulmonares/fisiopatología , Recurrencia , Reproducibilidad de los Resultados , Estudios Retrospectivos , Medición de Riesgo , Factores de Riesgo , Resultado del TratamientoRESUMEN
The main purpose of the study was to develop a high accuracy system able to diagnose skin lesions using deep learning-based methods. We propose a new decision system based on multiple classifiers like neural networks and feature-based methods. Each classifier (method) gives the final decision system a certain weight, depending on the calculated accuracy, helping the system make a better decision. First, we created a neural network (NN) that can differentiate melanoma from benign nevus. The NN architecture is analyzed by evaluating it during the training process. Some biostatistic parameters, such as accuracy, specificity, sensitivity, and Dice coefficient are calculated. Then, we developed three other methods based on convolutional neural networks (CNNs). The CNNs were pre-trained using large ImageNet and Places365 databases. GoogleNet, ResNet-101, and NasNet-Large, were used in the enumeration order. CNN architectures were fine-tuned in order to distinguish the different types of skin lesions using transfer learning. The accuracies of the classifications were determined. The last proposed method uses the classical method of image object detection, more precisely, the one in which some features are extracted from the images, followed by the classification step. In this case, the classification was done by using a support vector machine. Just as in the first method, the sensitivity, specificity, Dice similarity coefficient and accuracy are determined. A comparison of the obtained results from all the methods is then done. As mentioned above, the novelty of this paper is the integration of these methods in a global fusion-based decision system that uses the results obtained by each individual method to establish the fusion weights. The results obtained by carrying out the experiments on two different free databases shows that the proposed system offers higher accuracy results.
Asunto(s)
Aprendizaje Profundo , Aprendizaje Automático , Redes Neurales de la Computación , Enfermedades de la Piel/diagnóstico , Algoritmos , Inteligencia Artificial , Humanos , Máquina de Vectores de SoporteRESUMEN
The growing need for food worldwide requires the development of a high-performance, high-productivity, and sustainable agriculture, which implies the introduction of new technologies into monitoring activities related to control and decision-making. In this regard, this paper presents a hierarchical structure based on the collaboration between unmanned aerial vehicles (UAVs) and federated wireless sensor networks (WSNs) for crop monitoring in precision agriculture. The integration of UAVs with intelligent, ground WSNs, and IoT proved to be a robust and efficient solution for data collection, control, analysis, and decisions in such specialized applications. Key advantages lay in online data collection and relaying to a central monitoring point, while effectively managing network load and latency through optimized UAV trajectories and in situ data processing. Two important aspects of the collaboration were considered: designing the UAV trajectories for efficient data collection and implementing effective data processing algorithms (consensus and symbolic aggregate approximation) at the network level for the transmission of the relevant data. The experiments were carried out at a Romanian research institute where different crops and methods are developed. The results demonstrate that the collaborative UAV-WSN-IoT approach increases the performances in both precision agriculture and ecological agriculture.