(En)trust me: Validating an assessment rubric for documenting clinical encounters during a surgery clerkship clinical skills exam - 11/02/20
, Jesse S. Moore b , Peter W. Callas c , Cate Nicholas d , Michael Hulme e Abstract |
Background |
The AAMC developed 13 Core Entrustable Professional Activities (EPAs) for graduating medical students. EPA 5 is: Document a clinical encounter in the patient record. Our goal was to develop an assessment rubric and gather evidence to support its validity in measuring progress towards entrustability.
Methods |
A rubric was developed for EPA 5. During the 2017 surgery clerkship, 57 students wrote a note for each of two standardized patient (SP) encounters. These notes were prospectively collected and assessed by two physician raters. Messick's validity framework was used to gather validity data.
Results |
Inter-rater reliability with two raters was excellent, ICC = 0.86 (ICC 95%, confidence interval (CI) 0.80–0.90) for overall note score. Correlation between note items and SP checklists ranged 0.39–0.46 (p < 0.05) and between note items and clinical evaluations 0.28–0.39 (p < 0.05).
Conclusions |
There is initial reliability evidence supporting the use of our rubric for assessing progress towards entrustability of EPA 5.
Le texte complet de cet article est disponible en PDF.Highlights |
• | The rubric developed demonstrates content validity for EPA 5. |
• | IRR was moderate to excellent within our note domains with two raters. |
• | Note components moderately correlated with similar clinical evaluation components. |
• | Note items correlated with similar domains on the standardized patient checklist. |
Keywords : Entrustable Professional Activity (EPA), Rubric, Assessment, Validity
Plan
| ☆ | Our goal was to develop an assessment rubric and gather evidence to support its validity in measuring progress towards entrustability of EPA 5. The application of this rubric demonstrates initial evidence to support content validity. Additionally, there is initial reliability evidence to support the use of our rubric for assessment of progress towards entrustability of EPA 5. |
Vol 219 - N° 2
P. 258-262 - février 2020 Retour au numéro
Article précédent
- The surgical consult entrustable professional activity (EPA): Defining competence as a basis for evaluation
- Ryland S. Stucke, Meredith Sorensen, Alexandra Rosser, Sarah Sullivan
- Design, implementation and long-term follow-up of a context specific trauma training course in Uganda: Lessons learned and future directions
- Sarah J. Ullrich, Cathy Kilyewala, Michael S. Lipnick, Maija Cheung, Martha Namugga, Peter Muwanguzi, Michael P. DeWane, Arlene Muzira, Janat Tumukunde, Monica Kabagambe, Naomi Kebba, Moses Galukande, Jacqueline Mabweijano, Doruk Ozgediz
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?