Prognostic performance of disease severity scores in patients with septic shock presenting to the emergency department

Published:August 22, 2018DOI:



      An accurate disease severity score that can quickly predict the prognosis of patients with sepsis in the emergency department (ED) can aid clinicians in distributing resources appropriately or making decisions for active resuscitation measures. This study aimed to compare the prognostic performance of quick sequential organ failure assessment (qSOFA) with that of other disease severity scores in patients with septic shock presenting to an ED.


      We performed a prospective, observational, registry-based study. The discriminative ability of each disease severity score to predict 28-day mortality was evaluated in the overall cohort (which included patients who fulfilled previously defined criteria for septic shock), the newly defined sepsis subgroup, and the newly defined septic shock subgroup.


      A total of 991 patients were included. All disease severity scores had poor discriminative ability for 28-day mortality. The sequential organ failure assessment and acute physiology and chronic health evaluation II scores had the highest area under the receiver-operating characteristic curve (AUC) values, which were significantly higher than the AUC values of other disease severity scores in the overall cohort and the sepsis and septic shock subgroups. The discriminative ability of each disease severity score decreased as the mortality rate of each subgroup increased.


      All disease severity scores, including qSOFA, did not display good discrimination for 28-day mortality in patients with serious infection and refractory hypotension or hypoperfusion; additionally, none of the included scoring tools in this study could consistently predict 28-day mortality in the newly defined sepsis and septic shock subgroups.


      SIRS (systemic inflammatory response syndrome), SOFA (sequential organ failure assessment), MAP (mean arterial pressure), qSOFA (quick sequential organ failure assessment), SBP (systolic blood pressure), ED (emergency department), MEDS (Mortality in Emergency Department Sepsis), KoSS (Korean Shock Society), APACHE (acute physiology and chronic health evaluation), MISSED (mortality in severe sepsis in the emergency department), SD (standard deviation), AUC (area under the curve), CI (confidence interval), ICU (intensive care unit)


      To read this article in full you will need to make a payment
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to The American Journal of Emergency Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Stevenson E.K.
        • Rubenstein A.R.
        • Radin G.T.
        • Wiener R.S.
        • Walkey A.J.
        Two decades of mortality trends among patients with severe sepsis: a comparative meta-analysis.
        Crit Care Med. 2014; 42: 625-631
        • Bone R.C.
        • Balk R.A.
        • Cerra F.B.
        • Dellinger R.P.
        • Fein A.M.
        • Knaus W.A.
        • et al.
        Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis.
        Chest. 1992; 101: 1644-1655
        • Levy M.M.
        • Fink M.P.
        • Marshall J.C.
        • Abraham E.
        • Angus D.
        • Cook D.
        • et al.
        2001 SCCM/ESICM/ACCP/ATS/SIS international sepsis definitions conference.
        Crit Care Med. 2003; 31: 1250-1256
        • Shankar-Hari M.
        • Phillips G.S.
        • Levy M.L.
        • Seymour C.W.
        • Liu V.X.
        • Deutschman C.S.
        • et al.
        Developing a new definition and assessing new clinical criteria for septic shock: for the third international consensus definitions for sepsis and septic shock (sepsis-3).
        JAMA. 2016; 315: 775-787
        • Seymour C.W.
        • Liu V.X.
        • Iwashyna T.J.
        • Brunkhorst F.M.
        • Rea T.D.
        • Scherag A.
        • et al.
        Assessment of clinical criteria for sepsis: for the third international consensus definitions for sepsis and septic shock (sepsis-3).
        JAMA. 2016; 315: 762-774
        • Williams J.M.
        • Greenslade J.H.
        • McKenzie J.V.
        • Chu K.
        • Brown A.F.T.
        • Lipman J.
        Systemic inflammatory response syndrome, quick sequential organ function assessment, and organ dysfunction: insights from a prospective database of ED patients with infection.
        Chest. 2017; 151: 586-596
        • Wang J.Y.
        • Chen Y.X.
        • Guo S.B.
        • Mei X.
        • Yang P.
        Predictive performance of quick sepsis-related Organ Failure Assessment for mortality and ICU admission in patients with infection at the ED.
        Am J Emerg Med. 2016; 34: 1788-1793
        • Shin T.G.
        • Hwang S.Y.
        • Kang G.H.
        • Kim W.Y.
        • Ryoo S.M.
        • Kim K.
        • et al.
        Korean Shock Society septic shock registry: a preliminary report.
        Clin Exp Emerg Med. 2017; 4: 146-153
        • Ko B.S.
        • Kim K.
        • Choi S.-H.
        • Kang G.H.
        • Shin T.G.
        • Jo Y.H.
        • et al.
        Prognosis of patients excluded by the definition of septic shock based on their lactate levels after initial fluid resuscitation: a prospective multi-center observational study.
        Crit Care. 2018; 22: 47
        • Ryoo S.M.
        • Kang G.H.
        • Shin T.G.
        • Hwang S.Y.
        • Kim K.
        • Jo Y.H.
        • et al.
        Clinical outcome comparison of patients with septic shock defined by the new sepsis-3 criteria and by previous criteria.
        J Thorac Dis. 2018; 10: 845-853
        • Kaukonen K.-M.
        • Bailey M.
        • Pilcher D.
        • Cooper D.J.
        • Bellomo R.
        Systemic inflammatory response syndrome criteria in defining severe sepsis.
        N Engl J Med. 2015; 372: 1629-1638
        • Vincent J.L.M.R.
        • Takala J.
        • Willatts S.
        • De Mendonça A.
        • Bruining H.
        • Reinhart C.K.
        • et al.
        The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure.
        Intensive Care Med. 1996; 22: 707-710
        • Knaus W.A.
        • Draper E.A.
        • Wagner D.P.
        • Zimmerman J.E.
        APACHE II: a severity of disease classification system.
        Crit Care Med. 1985; 13: 818-829
        • Sivayoham N.
        • Rhodes A.
        • Cecconi M.
        The MISSED score, a new scoring system to predict Mortality In Severe Sepsis in the Emergency Department: a derivation and validation study.
        Eur J Emerg Med. 2014; 21: 30-36
        • Howell M.D.
        • Donnino M.W.
        • Talmor D.
        • Clardy P.
        • Ngo L.
        • Shapiro N.I.
        Performance of severity of illness scoring systems in emergency department patients with infection.
        Acad Emerg Med. 2007; 14: 709-714
        • Slade E.
        • Tamber P.S.
        • Vincent J.L.
        The Surviving Sepsis Campaign: raising awareness to reduce mortality.
        Crit Care. 2003; 7: 1-2
        • Jones A.E.
        • Focht A.
        • Horton J.M.
        • Kline J.A.
        Prospective external validation of the clinical effectiveness of an emergency department-based early goal-directed therapy protocol for severe sepsis and septic shock.
        Chest. 2007; 132: 425-432
        • Puskarich M.A.
        • Marchick M.R.
        • Kline J.A.
        • Steuerwald M.T.
        • Jones A.E.
        One year mortality of patients treated with an emergency department based early goal directed therapy protocol for severe sepsis and septic shock: a before and after study.
        Crit Care. 2009; 13: R167
        • Rivers E.
        • Nguyen B.
        • Havstad S.
        • Ressler J.
        • Muzzin A.
        • Knoblich B.
        • et al.
        Early goal-directed therapy in the treatment of severe sepsis and septic shock.
        N Engl J Med. 2001; 345: 1368-1377
        • Henriksen D.P.
        • Laursen C.B.
        • Hallas J.
        • Pedersen C.
        • Lassen A.T.
        Time to initial antibiotic administration, and short-term mortality among patients admitted with community-acquired severe infections with and without the presence of systemic inflammatory response syndrome: a follow-up study.
        Emerg Med J. 2015; 32: 846-853
        • Freund Y.
        • Lemachatti N.
        • Krastinova E.
        • Van Laer M.
        • Claessens Y.E.
        • Avondo A.
        • et al.
        Prognostic accuracy of sepsis-3 criteria for in-hospital mortality among patients with suspected infection presenting to the emergency department.
        JAMA. 2017; 317: 301-308
        • Raith E.P.
        • Udy A.A.
        • Bailey M.
        • McGloughlin S.
        • MacIsaac C.
        • Bellomo R.
        • et al.
        Prognostic accuracy of the SOFA score, SIRS criteria, and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit.
        JAMA. 2017; 317: 290-300
        • Murphy-Filkins R.
        • Teres D.
        • Lemeshow S.
        • Hosmer D.W.
        Effect of changing patient mix on the performance of an intensive care unit severity-of-illness model: how to distinguish a general from a specialty intensive care unit.
        Crit Care Med. 1996; 24: 1968-1973
        • Glance L.G.
        • Osler T.
        • Shinozaki T.
        Effect of varying the case mix on the standardized mortality ratio and W statistic: a simulation study.
        Chest. 2000; 117: 1112-1117
        • Crowe C.
        • Kulstad E.
        • Mistry C.
        • Kulstad C.
        Comparison of severity of illness scoring systems in the prediction of hospital mortality in severe sepsis and septic shock.
        J Emerg Trauma Shock. 2010; 3: 342-347
        • Williams J.M.
        • Greenslade J.H.
        • Chu K.
        • Brown A.F.
        • Lipman J.
        Severity scores in emergency department patients with presumed infection: a prospective validation study.
        Crit Care Med. 2016; 44: 539-547