RESUMEN
Out-of-hospital cardiac arrest (OHCA) is a critical condition with low survival rates. In patients with a return of spontaneous circulation, brain injury is a leading cause of death. In this study, we propose an interpretable machine learning approach for predicting neurologic outcome after OHCA, using information available at the time of hospital admission. METHODS: The study population were 55 615 OHCA cases registered in the Swedish Cardiopulmonary Resuscitation Registry between 2010 and 2020. The dataset was split to training and validation sets (for model development) and test set (for evaluation of the final model). We used an XGBoost algorithm with stratified, repeated 10-fold cross-validation along with Optuna framework for hyperparameters tuning. The final model was trained on 10 features selected based on the importance scores and evaluated on the test set in terms of discrimination, calibration and bias-variance tradeoff. We used SHapley Additive exPlanations to address the 'black-box' model and align with eXplainable artificial intelligence. RESULTS: The final model achieved: area under the receiver operating characteristic value 0.964 (95% confidence interval (CI) [0.960-0.968]), sensitivity 0.606 (95% CI [0.573-0.634]), specificity 0.975 (95% CI [0.972-0.978]), positive predictive value (PPV) 0.664 (95% CI [0.625-0.696]), negative predictive value (NPV) 0.969 (95% CI [0.966-0.972]), macro F1 0.803 (95% CI [0.788-0.816]), and showed a very good calibration. SHAP features with the highest impact on the model's output were:'ROSC on arrival to hospital', 'Initial rhythm asystole' and 'Conscious on arrival to hospital'. CONCLUSIONS: The XGBoost machine learning model with 10 features available at the time of hospital admission showed good performance for predicting neurologic outcome after OHCA, with no apparent signs of overfitting.
Asunto(s)
Reanimación Cardiopulmonar , Aprendizaje Automático , Paro Cardíaco Extrahospitalario , Sistema de Registros , Humanos , Paro Cardíaco Extrahospitalario/terapia , Paro Cardíaco Extrahospitalario/mortalidad , Masculino , Femenino , Anciano , Suecia/epidemiología , Reanimación Cardiopulmonar/métodos , Persona de Mediana Edad , Curva ROCRESUMEN
BACKGROUND: A prediction model that estimates mortality at admission to the intensive care unit (ICU) is of potential benefit to both patients and society. Logistic regression models like Simplified Acute Physiology Score 3 (SAPS 3) and APACHE are the traditional ICU mortality prediction models. With the emergence of machine learning (machine learning) and artificial intelligence, new possibilities arise to create prediction models that have the potential to sharpen predictive accuracy and reduce the likelihood of misclassification in the prediction of 30-day mortality. METHODS: We used the Swedish Intensive Care Registry (SIR) to identify and include all patients ≥18 years of age admitted to general ICUs in Sweden from 2008 to 2022 with SAPS 3 score registered. Only data collected within 1 h of ICU admission was used. We had 153 candidate predictors including baseline characteristics, previous medical conditions, blood works, physiological parameters, cause of admission, and initial treatment. We stratified the data randomly on the outcome variable 30-day mortality and created a training set (80% of data) and a test set (20% of data). We evaluated several hundred prediction models using multiple ML frameworks including random forest, gradient boosting, neural networks, and logistic regression models. Model performance was evaluated by comparing the receiver operator characteristic area under the curve (AUC-ROC). The best performing model was fine-tuned by optimizing hyperparameters. The model's calibration was evaluated by a calibration belt. Ultimately, we simplified the best performing model with the top 1-20 predictors. RESULTS: We included 296,344 first-time ICU admissions. We found age, Glasgow Coma Scale, creatinine, systolic blood pressure, and pH being the most important predictors. The AUC-ROC was 0.884 in test data using all predictors, specificity 95.2%, sensitivity 47.0%, negative predictive value of 87.9% and positive predictive value of 70.7%. The final model showed excellent calibration. The ICU risk evaluation for 30-day mortality (ICURE) prediction model performed equally well to the SAPS 3 score with only eight variables and improved further with the addition of more variables. CONCLUSION: The ICURE prediction model predicts 30-day mortality rate at first-time ICU admission superiorly compared to the established SAPS 3 score.