(En)trust me: Validating an assessment rubric for documenting clinical encounters during a surgery clerkship clinical skills exam - 11/02/20
, Jesse S. Moore b
, Peter W. Callas c
, Cate Nicholas d
, Michael Hulme e 
Abstract |
Background |
The AAMC developed 13 Core Entrustable Professional Activities (EPAs) for graduating medical students. EPA 5 is: Document a clinical encounter in the patient record. Our goal was to develop an assessment rubric and gather evidence to support its validity in measuring progress towards entrustability.
Methods |
A rubric was developed for EPA 5. During the 2017 surgery clerkship, 57 students wrote a note for each of two standardized patient (SP) encounters. These notes were prospectively collected and assessed by two physician raters. Messick's validity framework was used to gather validity data.
Results |
Inter-rater reliability with two raters was excellent, ICC = 0.86 (ICC 95%, confidence interval (CI) 0.80–0.90) for overall note score. Correlation between note items and SP checklists ranged 0.39–0.46 (p < 0.05) and between note items and clinical evaluations 0.28–0.39 (p < 0.05).
Conclusions |
There is initial reliability evidence supporting the use of our rubric for assessing progress towards entrustability of EPA 5.
Il testo completo di questo articolo è disponibile in PDF.Highlights |
• | The rubric developed demonstrates content validity for EPA 5. |
• | IRR was moderate to excellent within our note domains with two raters. |
• | Note components moderately correlated with similar clinical evaluation components. |
• | Note items correlated with similar domains on the standardized patient checklist. |
Keywords : Entrustable Professional Activity (EPA), Rubric, Assessment, Validity
Mappa
| ☆ | Our goal was to develop an assessment rubric and gather evidence to support its validity in measuring progress towards entrustability of EPA 5. The application of this rubric demonstrates initial evidence to support content validity. Additionally, there is initial reliability evidence to support the use of our rubric for assessment of progress towards entrustability of EPA 5. |
Vol 219 - N° 2
P. 258-262 - febbraio 2020 Ritorno al numeroBenvenuto su EM|consulte, il riferimento dei professionisti della salute.
L'accesso al testo integrale di questo articolo richiede un abbonamento.
Già abbonato a @@106933@@ rivista ?
