Limits...
Using electronic health record collected clinical variables to predict medical intensive care unit mortality

View Article: PubMed Central - PubMed

ABSTRACT

Background: Clinical decision support systems are used to help predict patient stability and mortality in the Intensive Care Unit (ICU). Accurate patient information can assist clinicians with patient management and in allocating finite resources. However, systems currently in common use have limited predictive value in the clinical setting. The increasing availability of Electronic Health Records (EHR) provides an opportunity to use medical information for more accurate patient stability and mortality prediction in the ICU.

Objective: Develop and evaluate an algorithm which more accurately predicts patient mortality in the ICU, using the correlations between widely available clinical variables from the EHR.

Methods: We have developed an algorithm, AutoTriage, which uses eight common clinical variables from the EHR to assign patient mortality risk scores. Each clinical variable produces a subscore, and combinations of two or three discretized clinical variables also produce subscores. A combination of weighted subscores produces the overall score. We validated the performance of this algorithm in a retrospective study on the MIMIC III medical ICU dataset.

Results: AutoTriage 12 h mortality prediction yields an Area Under Receiver Operating Characteristic value of 0.88 (95% confidence interval 0.86 to 0.88). At a sensitivity of 80%, AutoTriage maintains a specificity of 81% with a diagnostic odds ratio of 16.26.

Conclusions: Through the multidimensional analysis of the correlations between eight common clinical variables, AutoTriage provides an improvement in the specificity and sensitivity of patient mortality prediction over existing prediction methods.

No MeSH data available.


Related in: MedlinePlus

Receiver Operating Characteristic (ROC) curves for 12-h mortality prediction in the Medical Intensive Care Unit for AutoTriage, Modified Early Warning Score (MEWS), Sequential Organ Failure Assessment (SOFA), and Simplified Acute Physiology Score (SAPS II). A MEWS of at least 3 has a specificity of 74% and a sensitivity of 66%, whereas an AutoTriage threshold of −2 at a similar specificity of 81% has a sensitivity of 80%.
© Copyright Policy - CC BY-NC-ND
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC5037117&req=5

fig2: Receiver Operating Characteristic (ROC) curves for 12-h mortality prediction in the Medical Intensive Care Unit for AutoTriage, Modified Early Warning Score (MEWS), Sequential Organ Failure Assessment (SOFA), and Simplified Acute Physiology Score (SAPS II). A MEWS of at least 3 has a specificity of 74% and a sensitivity of 66%, whereas an AutoTriage threshold of −2 at a similar specificity of 81% has a sensitivity of 80%.

Mentions: AutoTriage 12 h mortality prediction on the test set is shown in Fig. 2, yielding an Area Under Receiver Operating Characteristic (AUROC) value of 0.88 (95% confidence interval 0.86 to 0.88). Four-fold cross validation results in similar AUROCs. In comparison, MEWS, SAPS II and SOFA calculations on the same data set yield an AUROC of 0.75, 0.71, and 0.72, respectively.


Using electronic health record collected clinical variables to predict medical intensive care unit mortality
Receiver Operating Characteristic (ROC) curves for 12-h mortality prediction in the Medical Intensive Care Unit for AutoTriage, Modified Early Warning Score (MEWS), Sequential Organ Failure Assessment (SOFA), and Simplified Acute Physiology Score (SAPS II). A MEWS of at least 3 has a specificity of 74% and a sensitivity of 66%, whereas an AutoTriage threshold of −2 at a similar specificity of 81% has a sensitivity of 80%.
© Copyright Policy - CC BY-NC-ND
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC5037117&req=5

fig2: Receiver Operating Characteristic (ROC) curves for 12-h mortality prediction in the Medical Intensive Care Unit for AutoTriage, Modified Early Warning Score (MEWS), Sequential Organ Failure Assessment (SOFA), and Simplified Acute Physiology Score (SAPS II). A MEWS of at least 3 has a specificity of 74% and a sensitivity of 66%, whereas an AutoTriage threshold of −2 at a similar specificity of 81% has a sensitivity of 80%.
Mentions: AutoTriage 12 h mortality prediction on the test set is shown in Fig. 2, yielding an Area Under Receiver Operating Characteristic (AUROC) value of 0.88 (95% confidence interval 0.86 to 0.88). Four-fold cross validation results in similar AUROCs. In comparison, MEWS, SAPS II and SOFA calculations on the same data set yield an AUROC of 0.75, 0.71, and 0.72, respectively.

View Article: PubMed Central - PubMed

ABSTRACT

Background: Clinical decision support systems are used to help predict patient stability and mortality in the Intensive Care Unit (ICU). Accurate patient information can assist clinicians with patient management and in allocating finite resources. However, systems currently in common use have limited predictive value in the clinical setting. The increasing availability of Electronic Health Records (EHR) provides an opportunity to use medical information for more accurate patient stability and mortality prediction in the ICU.

Objective: Develop and evaluate an algorithm which more accurately predicts patient mortality in the ICU, using the correlations between widely available clinical variables from the EHR.

Methods: We have developed an algorithm, AutoTriage, which uses eight common clinical variables from the EHR to assign patient mortality risk scores. Each clinical variable produces a subscore, and combinations of two or three discretized clinical variables also produce subscores. A combination of weighted subscores produces the overall score. We validated the performance of this algorithm in a retrospective study on the MIMIC III medical ICU dataset.

Results: AutoTriage 12 h mortality prediction yields an Area Under Receiver Operating Characteristic value of 0.88 (95% confidence interval 0.86 to 0.88). At a sensitivity of 80%, AutoTriage maintains a specificity of 81% with a diagnostic odds ratio of 16.26.

Conclusions: Through the multidimensional analysis of the correlations between eight common clinical variables, AutoTriage provides an improvement in the specificity and sensitivity of patient mortality prediction over existing prediction methods.

No MeSH data available.


Related in: MedlinePlus