This study aims to develop a machine learning (ML)-based pipeline to predict intensive care unit (ICU) mortality and length of stay (LOS). A dataset including 140,904 ICU admissions was collected from 15 public hospitals in Hong Kong over an 11-year period. The proposed pipeline deployed a suite of ML models to predict mortality and LOS. The performance of ML models was compared with the Acute Physiology and Chronic Health Evaluation (APACHE) systems on the collected dataset using five-fold cross-validation. Among all involved models, the Gradient Boosting with Categorical Features (CatBoost) achieved the highest area under the receiver operating characteristic curve (AUROC) of 0.9070 as well as the lowest Brier score of 0.0827 for mortality prediction and the lowest Mean Absolute Error (MAE) of 2.6364 for LOS prediction. The SHapley Additive exPlanations (SHAP) analysis conducted on CatBoost revealed that age, Glasgow Coma Scale (GCS) and urine output were the top-three important features for mortality prediction, whereas the top-three important features for LOS prediction were creatinine level, and the indicators for whether the lowest and highest respiratory rates were ventilator-measured. We further performed temporal validation and an in-depth analysis of CatBoost’s predictive performance across subsets grouped by age and hospital. Our results demonstrate that the proposed pipeline mitigates the overestimation of mortality predictions from APACHE systems in Hong Kong. Besides, the proposed predictive ML-based pipeline offers a transferable framework for researchers to develop models tailored to their local medical environments.
Zhao et al. (Tue,) studied this question.