Identifying low-risk chest pain in the emergency department: Obstructive coronary artery disease and major adverse cardiac events



      Accurate risk stratification for obstructive coronary artery disease (CAD) and major cardiac adverse events (MACE) is important in emergency departments. We compared six established chest pain risk scores (the HEART score, CAD basic model, CAD clinical model, TIMI, GRACE, uDF) for prediction of obstructive CAD and MACE.


      Patients who presented to the emergency department with chest pain or symptoms of suspected CAD and underwent coronary computed tomographic angiography were analyzed. The primary endpoint was adverse outcomes including the presence of obstructive CAD (≥50% stenosis) and the occurrence of MACE within 6 weeks. We compared the risk scores by the area under the receiver-operating characteristic curve (AUC) and calculated their respective net reclassification index (NRI).


      Adverse outcomes occurred in 285 (28.4%) out of the 1002 patients included. For the prediction of adverse outcomes, the AUC of the HEART score (0.792) was superior to those of the CAD clinical model (0.760), CAD basic model (0.749), TIMI (0.749), uDF (0.703), and GRACE (0.653). In terms of the NRI, the HEART score significantly improved the reclassification abilities of the uDF (0.39), GRACE score (0.27), CAD basic model (0.11), TIMI (0.10), and CAD clinical model (0.08) (all P < 0.05). The HEART score also had the highest negative predictive value as well (0.893).


      The HEART score was superior to other cardiac risk scores in predicting both obstructive CAD and MACE. However, due to the high false-negative rate (11%) of the HEART score, its use for identifying low-risk patients should be considered with caution.


      To read this article in full you will need to make a payment
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to The American Journal of Emergency Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Yusuf S.
        • Rangarajan S.
        • Teo K.
        • Islam S.
        • Li W.
        • Liu L.
        • et al.
        Cardiovascular risk and events in 17 low-, middle-, and high-income countries.
        N Engl J Med. 2014; 371: 818-827
        • Patel M.R.
        • Peterson E.D.
        • Dai D.
        • Brennan J.M.
        • Redberg R.F.
        • Anderson H.V.
        • et al.
        Low diagnostic yield of elective coronary angiography.
        N Engl J Med. 2010; 362: 886-895
        • Fihn S.D.
        • Gardin J.M.
        • Abrams J.
        • Berra K.
        • Blankenship J.C.
        • Dallas A.P.
        • et al.
        2012 ACCF/AHA/ACP/AATS/PCNA/SCAI/STS guideline for the diagnosis and management of patients with stable ischemic heart disease: a report of the American College of Cardiology Foundation/American Heart Association task force on practice guidelines, and the American College of Physicians, American Association for Thoracic Surgery, Preventive Cardiovascular Nurses Association, Society for Cardiovascular Angiography and Interventions, and Society of Thoracic Surgeons.
        Circulation. 2012; 126: e354-e471
        • Montalescot G.
        • Sechtem U.
        • Achenbach S.
        • Andreotti F.
        • Arden C.
        • Budaj A.
        • et al.
        2013 ESC guidelines on the management of stable coronary artery disease: the Task Force on the management of stable coronary artery disease of the European Society of Cardiology.
        Eur Heart J. 2013; 34: 2949-3003
        • Pollack Jr., C.V.
        • Sites F.D.
        • Shofer F.S.
        • Sease K.L.
        • Hollander J.E.
        Application of the TIMI risk score for unstable angina and non-ST elevation acute coronary syndrome to an unselected emergency department chest pain population.
        Acad Emerg Med. 2006; 13: 13-18
        • Antman E.M.
        • Cohen M.
        • Bernink P.J.
        • McCabe C.H.
        • Horacek T.
        • Papuchis G.
        • et al.
        The TIMI risk score for unstable angina/non-ST elevation MI: a method for prognostication and therapeutic decision making.
        JAMA. 2000; 284: 835-842
        • Backus B.E.
        • Six A.J.
        • Kelder J.C.
        • Mast T.P.
        • van den Akker F.
        • Mast E.G.
        • et al.
        Chest pain in the emergency room: a multicenter validation of the HEART Score.
        Crit Pathw Cardiol. 2010; 9: 164-169
        • Cakar M.A.
        • Sahinkus S.
        • Aydin E.
        • Vatan M.B.
        • Keser N.
        • Akdemir R.
        • et al.
        Relation between the GRACE score and severity of atherosclerosis in acute coronary syndrome.
        J Cardiol. 2014; 63: 24-28
        • Hammami R.
        • Jdidi J.
        • Mroua F.
        • Kallel R.
        • Hentati M.
        • Abid L.
        • et al.
        Accuracy of the TIMI and GRACE scores in predicting coronary disease in patients with non-ST-elevation acute coronary syndrome.
        Rev Port Cardiol. 2018; 37: 41-49
        • Garcia S.
        • Canoniero M.
        • Peter A.
        • de Marchena E.
        • Ferreira A.
        Correlation of TIMI risk score with angiographic severity and extent of coronary artery disease in patients with non-ST-elevation acute coronary syndromes.
        Am J Cardiol. 2004; 93: 813-816
        • Harris P.J.
        • Behar V.S.
        • Conley M.J.
        • Harrell Jr., F.E.
        • Lee K.L.
        • Peter R.H.
        • et al.
        The prognostic significance of 50% coronary stenosis in medically treated patients with coronary artery disease.
        Circulation. 1980; 62: 240-248
        • Poldervaart J.M.
        • Reitsma J.B.
        • Backus B.E.
        • Koffijberg H.
        • Veldkamp R.F.
        • Ten Haaf M.E.
        • et al.
        Effect of using the HEART score in patients with chest pain in the emergency department: a stepped-wedge, cluster randomized trial.
        Ann Intern Med. 2017; 166: 689-697
        • Thygesen K.
        • Alpert J.S.
        • Jaffe A.S.
        • Simoons M.L.
        • Chaitman B.R.
        • White H.D.
        • et al.
        Third universal definition of myocardial infarction.
        Circulation. 2012; 126: 2020-2035
        • Apple F.S.
        • Smith S.W.
        • Pearce L.A.
        • Ler R.
        • Murakami M.M.
        Use of the Centaur TnI-Ultra assay for detection of myocardial infarction and adverse events in patients presenting with symptoms suggestive of acute coronary syndrome.
        Clin Chem. 2008; 54: 723-728
        • Ferreira A.M.
        • Marques H.
        • Tralhao A.
        • Santos M.B.
        • Santos A.R.
        • Cardoso G.
        • et al.
        Pre-test probability of obstructive coronary stenosis in patients undergoing coronary CT angiography: comparative performance of the modified diamond-Forrester algorithm versus methods incorporating cardiovascular risk factors.
        Int J Cardiol. 2016; 222: 346-351
        • Sorgaard M.
        • Linde J.J.
        • Kofoed K.F.
        • Kuhl J.T.
        • Kelbaek H.
        • Nielsen W.B.
        • et al.
        Diagnostic value of the updated Diamond and Forrester score to predict coronary artery disease in patients with acute-onset chest pain.
        Cardiology. 2016; 133: 10-17
        • Genders T.S.
        • Steyerberg E.W.
        • Hunink M.G.
        • Nieman K.
        • Galema T.W.
        • Mollet N.R.
        • et al.
        Prediction model to estimate presence of coronary artery disease: retrospective pooled analysis of existing cohorts.
        BMJ. 2012; 344: e3485
        • Abu-Assi E.
        • Ferreira-Gonzalez I.
        • Ribera A.
        • Marsal J.R.
        • Cascant P.
        • Heras M.
        • et al.
        Do GRACE (Global Registry of Acute Coronary events) risk scores still maintain their performance for predicting mortality in the era of contemporary management of acute coronary syndromes.
        Am Heart J. 2010; 160 (e1-3): 826-834
        • Six A.J.
        • Backus B.E.
        • Kelder J.C.
        Chest pain in the emergency room: value of the HEART score.
        Neth Heart J. 2008; 16: 191-196
        • Hamm C.W.
        • Bassand J.P.
        • Agewall S.
        • Bax J.
        • Boersma E.
        • Bueno H.
        • et al.
        ESC guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation: the Task Force for the management of acute coronary syndromes (ACS) in patients presenting without persistent ST-segment elevation of the European Society of Cardiology (ESC).
        Eur Heart J. 2011; 32: 2999-3054
        • DeLong E.R.
        • DeLong D.M.
        • Clarke-Pearson D.L.
        Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.
        Biometrics. 1988; 44: 837-845
        • Kerr K.F.
        • Wang Z.
        • Janes H.
        • McClelland R.L.
        • Psaty B.M.
        • Pepe M.S.
        Net reclassification indices for evaluating risk prediction instruments: a critical review.
        Epidemiology. 2014; 25: 114-121
        • Pencina M.J.
        • D'Agostino Sr., R.B.
        • D'Agostino Jr., R.B.
        • Vasan R.S.
        Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond.
        Stat Med. 2008; 27 (discussion 207-12): 157-172
        • Poldervaart J.M.
        • Langedijk M.
        • Backus B.E.
        • Dekker I.M.C.
        • Six A.J.
        • Doevendans P.A.
        • et al.
        Comparison of the GRACE, HEART and TIMI score to predict major adverse cardiac events in chest pain patients at the emergency department.
        Int J Cardiol. 2017; 227: 656-661
        • Sakamoto J.T.
        • Liu N.
        • Koh Z.X.
        • Fung N.X.
        • Heldeweg M.L.
        • Ng J.C.
        • et al.
        Comparing HEART, TIMI, and GRACE scores for prediction of 30-day major adverse cardiac events in high acuity chest pain patients in the emergency department.
        Int J Cardiol. 2016; 221: 759-764
        • Andruchow J.E.
        • Kavsak P.A.
        • McRae A.D.
        Contemporary emergency department management of patients with chest pain: a concise review and guide for the high-sensitivity troponin era.
        Can J Cardiol. 2018; 34: 98-108
        • Westwood M.
        • van Asselt T.
        • Ramaekers B.
        • Whiting P.
        • Thokala P.
        • Joore M.
        • et al.
        High-sensitivity troponin assays for the early rule-out or diagnosis of acute myocardial infarction in people with acute chest pain: a systematic review and cost-effectiveness analysis.
        Health Technol Assess. 2015; 19: 1-234
        • Bittencourt M.S.
        • Hulten E.
        • Polonsky T.S.
        • Hoffman U.
        • Nasir K.
        • Abbara S.
        • et al.
        European Society of Cardiology-recommended coronary artery disease consortium pretest probability scores more accurately predict obstructive coronary disease and cardiovascular events than the Diamond and Forrester score: the Partners Registry.
        Circulation. 2016; 134: 201-211
        • Genders T.S.
        • Steyerberg E.W.
        • Alkadhi H.
        • Leschka S.
        • Desbiolles L.
        • Nieman K.
        • et al.
        A clinical prediction rule for the diagnosis of coronary artery disease: validation, updating, and extension.
        Eur Heart J. 2011; 32: 1316-1330
        • Reaney P.D.W.
        • Elliott H.I.
        • Noman A.
        • Cooper J.G.
        Risk stratifying chest pain patients in the emergency department using HEART, GRACE and TIMI scores, with a single contemporary troponin result, to predict major adverse cardiac events.
        Emerg Med J. 2018; 35: 420-427
        • Than M.
        • Flaws D.
        • Sanders S.
        • Doust J.
        • Glasziou P.
        • Kline J.
        • et al.
        Development and validation of the emergency department assessment of chest pain score and 2 h accelerated diagnostic protocol.
        Emerg Med Australas. 2014; 26: 34-44
        • Mark D.G.
        • Huang J.
        • Chettipally U.
        • Kene M.V.
        • Anderson M.L.
        • Hess E.P.
        • et al.
        Performance of coronary risk scores among patients with chest pain in the emergency department.
        J Am Coll Cardiol. 2018; 71: 606-616
        • Jensen J.M.
        • Voss M.
        • Hansen V.B.
        • Andersen L.K.
        • Johansen P.B.
        • Munkholm H.
        • et al.
        Risk stratification of patients suspected of coronary artery disease: comparison of five different models.
        Atherosclerosis. 2012; 220: 557-562
        • Wasfy M.M.
        • Brady T.J.
        • Abbara S.
        • Nasir K.
        • Ghoshhajra B.B.
        • Truong Q.A.
        • et al.
        Comparison of the Diamond-Forrester method and Duke Clinical Score to predict obstructive coronary artery disease by computed tomographic angiography.
        Am J Cardiol. 2012; 109: 998-1004