Measuring hospital adverse events: Assessing inter-rater reliability and trigger performance of the Global Trigger Tool

James M. Naessens, Thomas J. O'Byrne, Matthew G. Johnson, Monica B. Vansuch, Corey M. Mcglone, Jeanne M. Huddleston

Research output: Contribution to journalArticlepeer-review

75 Scopus citations


Objective: To determine the inter-rater reliability of the Institute for Healthcare Improvement's Global Trigger Tool (GTT) in a practice setting, and explore the value of individual triggers. Design: Prospective assessment of application of the GTT to monthly random samples of hospitalized patients at four hospitals across three regions in the USA. Setting: Mayo Clinic campuses are in Minnesota, Arizona and Florida. Participants: A total of 1138 non-pediatric inpatients from all units across the hospital. Intervention: GTT was applied to randomly selected medical records with independent assessments of two registered nurses with a physician review for confirmation. Main Outcome Measure: The Cohen Kappa coefficient was used as a measure of inter-rater agreement: The positive predictive value was assessed for individual triggers. Results: Good levels of reliability were obtained between independent nurse reviewers at the case-level for both the occurrence of any trigger and the identification of an adverse event. Nurse reviewer agreement for individual triggers was much more varied. Higher agreement appears to occur among triggers that are objective and consistently recorded in selected portions of the medical record. Individual triggers also varied on their yield to detect adverse events. Cases with adverse events had significantly more triggers identified (mean 4.7) than cases with no adverse events (mean 1.8). Conclusions: The trigger methodology appears to be a promising approach to the measurement of patient safety. However, automated processes could make the process more efficient in identifying adverse events and has a greater potential of improving care delivery and patient 'outcomes'.

Original languageEnglish (US)
Article numbermzq026
Pages (from-to)266-274
Number of pages9
JournalInternational Journal for Quality in Health Care
Issue number4
StatePublished - Jun 9 2010


  • Adverse events
  • Hospitals
  • Medical errors
  • Reliability

ASJC Scopus subject areas

  • Health Policy
  • Public Health, Environmental and Occupational Health


Dive into the research topics of 'Measuring hospital adverse events: Assessing inter-rater reliability and trigger performance of the Global Trigger Tool'. Together they form a unique fingerprint.

Cite this