Setting a Minimum Passing Standard for the Uncertainty Communication Checklist Through Patient and Physician Engagement - PubMed

Setting a Minimum Passing Standard for the Uncertainty Communication Checklist Through Patient and Physician Engagement - PubMed

Setting a Minimum Passing Standard for the Uncertainty Communication Checklist Through Patient and Physician Engagement

David H Salzman, Kristin L Rising, Kenzie A Cameron, Rhea E Powell, Dimitri Papanagnou, Amanda Doty, Katherine Piserchia, Lori Latimer, William C McGaghie, Danielle M McCarthy

• PMID: 32089795
 
• PMCID: PMC7012525 (available on 2021-02-01)
 
• DOI: 10.4300/JGME-D-19-00483.1

Abstract

Background: Historically, medically trained experts have served as judges to establish a minimum passing standard (MPS) for mastery learning. As mastery learning expands from procedure-based skills to patient-centered domains, such as communication, there is an opportunity to incorporate patients as judges in setting the MPS.

Objective: We described our process of incorporating patients as judges to set the MPS and compared the MPS set by patients and emergency medicine residency program directors (PDs).

Methods: Patient and physician panels were convened to determine an MPS for a 21-item Uncertainty Communication Checklist. The MPS for both panels were independently calculated using the Mastery Angoff method. Mean scores on individual checklist items with corresponding 95% confidence intervals were also calculated for both panels and differences analyzed using a t test.

Results: Of 240 eligible patients and 42 eligible PDs, 25 patients and 13 PDs (26% and 65% cooperation rates, respectively) completed MPS-setting procedures. The patient-generated MPS was 84.0% (range 45.2-96.2, SD 10.2) and the physician-generated MPS was 88.2% (range 79.7-98.1, SD 5.5). The overall MPS, calculated as an average of these 2 results, was 86.1% (range 45.2-98.1, SD 9.0), or 19 of 21 checklist items.

Conclusions: Patients are able to serve as judges to establish an MPS using the Mastery Angoff method for a task performed by resident physicians. The patient-established MPS was nearly identical to that generated by a panel of residency PDs, indicating similar expectations of proficiency for residents to achieve skill "mastery."

Accreditation Council for Graduate Medical Education 2020.

Conflict of interest statement

Conflict of interest: The authors declare they have no competing interests.

Similar articles

• Effect of Trainee Performance Data on Standard-Setting Judgments Using the Mastery Angoff Method.

  Prenner SB, McGaghie WC, Chuzi S, Cantey E, Didwania A, Barsuk JH.J Grad Med Educ. 2018 Jun;10(3):301-305. doi: 10.4300/JGME-D-17-00781.1.PMID: 29946387 Free PMC article.
• A Comparison of Approaches for Mastery Learning Standard Setting.

  Barsuk JH, Cohen ER, Wayne DB, McGaghie WC, Yudkowsky R.Acad Med. 2018 Jul;93(7):1079-1084. doi: 10.1097/ACM.0000000000002182.PMID: 29465449
• Mastery learning of thoracentesis skills by internal medicine residents using simulation technology and deliberate practice.

  Wayne DB, Barsuk JH, O'Leary KJ, Fudala MJ, McGaghie WC.J Hosp Med. 2008 Jan;3(1):48-54. doi: 10.1002/jhm.268.PMID: 18257046
• Development of a Simulation-Based Mastery Learning Curriculum for Breaking Bad News.

  Vermylen JH, Wood GJ, Cohen ER, Barsuk JH, McGaghie WC, Wayne DB.J Pain Symptom Manage. 2019 Mar;57(3):682-687. doi: 10.1016/j.jpainsymman.2018.11.012. Epub 2018 Nov 23.PMID: 30472316
• A mastery learning approach to education about fall risk and gait assessment.

  Bradley SM, Heiman HL, Bierman JA, O'Brien K, Cohen ER, Wayne DB.Gerontol Geriatr Educ. 2019 Aug 3:1-8. doi: 10.1080/02701960.2019.1651725. Online ahead of print.PMID: 31378157