Checklists, daily goal assessments, and clinician prompts

Here's another “systems improvement” initiative that didn't work. From a recent paper:

Importance The effectiveness of checklists, daily goal assessments, and clinician prompts as quality improvement interventions in intensive care units (ICUs) is uncertain.

Objective To determine whether a multifaceted quality improvement intervention reduces the mortality of critically ill adults.

Design, Setting, and Participants This study had 2 phases. Phase 1 was an observational study to assess baseline data on work climate, care processes, and clinical outcomes, conducted between August 2013 and March 2014 in 118 Brazilian ICUs. Phase 2 was a cluster randomized trial conducted between April and November 2014 with the same ICUs. The first 60 admissions of longer than 48 hours per ICU were enrolled in each phase.

Interventions Intensive care units were randomized to a quality improvement intervention, including a daily checklist and goal setting during multidisciplinary rounds with follow-up clinician prompting for 11 care processes, or to routine care.

Main Outcomes and Measures In-hospital mortality truncated at 60 days (primary outcome) was analyzed using a random-effects logistic regression model, adjusted for patients’ severity and the ICU’s baseline standardized mortality ratio. Exploratory secondary outcomes included adherence to care processes, safety climate, and clinical events.

Results A total of 6877 patients (mean age, 59.7 years; 3218 [46.8%] women) were enrolled in the baseline (observational) phase and 6761 (mean age, 59.6 years; 3098 [45.8%] women) in the randomized phase, with 3327 patients enrolled in ICUs (n = 59) assigned to the intervention group and 3434 patients in ICUs (n = 59) assigned to routine care. There was no significant difference in in-hospital mortality between the intervention group and the usual care group, with 1096 deaths (32.9%) and 1196 deaths (34.8%), respectively (odds ratio, 1.02; 95% CI, 0.82-1.26; P = .88). Among 20 prespecified secondary outcomes not adjusted for multiple comparisons, 6 were significantly improved in the intervention group (use of low tidal volumes, avoidance of heavy sedation, use of central venous catheters, use of urinary catheters, perception of team work, and perception of patient safety climate), whereas there were no significant differences between the intervention group and the control group for 14 outcomes (ICU mortality, central line–associated bloodstream infection, ventilator-associated pneumonia, urinary tract infection, mean ventilator-free days, mean ICU length of stay, mean hospital length of stay, bed elevation to ≥30°, venous thromboembolism prophylaxis, diet administration, job satisfaction, stress reduction, perception of management, and perception of working conditions).

Conclusions and Relevance Among critically ill patients treated in ICUs in Brazil, implementation of a multifaceted quality improvement intervention with daily checklists, goal setting, and clinician prompting did not reduce in-hospital mortality.