Efficacy and unintended consequences of hard-stop alerts in electronic health record systems: a systematic review.

Powers EM1,2, Shiffman RN1,2, Melnick ER1,3, Hickner A4, Sharifi M1,2.

Author information

1: Yale Center for Medical Informatics, Yale University School of Medicine, New Haven, Connecticut, USA.
2: Department of Pediatrics, Yale University School of Medicine, New Haven, Connecticut, USA.
3: Department of Emergency Medicine, Yale University School of Medicine, New Haven, Connecticut, USA.
4: Cushing/Whitney Medical Library, Yale University School of Medicine, New Haven, Connecticut, USA.

Abstract

OBJECTIVE:

Clinical decision support (CDS) hard-stop alerts-those in which the user is either prevented from taking an action altogether or allowed to proceed only with the external override of a third party-are increasingly common but can be problematic. To understand their appropriate application, we asked 3 key questions: (1) To what extent are hard-stop alerts effective in improving patient health and healthcare delivery outcomes? (2) What are the adverse events and unintended consequences of hard-stop alerts? (3) How do hard-stop alerts compare to soft-stop alerts?

METHODS AND MATERIALS:

Studies evaluating computerized hard-stop alerts in healthcare settings were identified from biomedical and computer science databases, gray literature sites, reference lists, and reviews. Articles were extracted for process outcomes, health outcomes, unintended consequences, user experience, and technical details.

RESULTS:

Of 32 studies, 15 evaluated health outcomes, 16 process outcomes only, 10 user experience, and 4 compared hard and soft stops. Seventy-nine percent showed improvement in health outcomes and 88% in process outcomes. Studies reporting good user experience cited heavy user involvement and iterative design. Eleven studies reported on unintended consequences including avoidance of hard-stopped workflow, increased alert frequency, and delay to care. Hard stops were superior to soft stops in 3 of 4 studies.

CONCLUSIONS:

Hard stops can be effective and powerful tools in the CDS armamentarium, but they must be implemented judiciously with continuous user feedback informing rapid, iterative design. Investigators must report on associated health outcomes and unintended consequences when implementing IT solutions to clinical problems.