Structured assessment format for evaluating operative reports in general surgery - 20/08/11
, Lawrence Gillman, M.D. a, Samuel Minor, M.D., F.R.C.S.C. b, Mark Taylor, M.D., F.R.C.S.C., MS.C. a, Jason Park, M.D., F.R.C.S.C., M.Ed. a
Corresponding author. Tel.: +1-204-787-3154; fax: +1-204-787-4837.Abstract |
Background |
Despite its multifaceted importance, no validated or reliable tools assess the quality of the dictated operative note. This study determined the construct validity, interrater reliability, and internal consistency of a Structured Assessment Format for Evaluating Operative Reports (SAFE-OR) in general surgery.
Methods |
SAFE-OR was developed by using consensus criteria set forth by the Canadian Association of General Surgeons. This instrument includes a structured assessment and a global quality rating scale. Residents divided into novice and experienced groups viewed and dictated a videotaped laparoscopic sigmoid colectomy. Blinded, independent faculty evaluators graded the transcribed reports using SAFE-OR.
Results |
Twenty-one residents participated in the study. Mean structured assessment scores (out of 44) were significantly lower for novice versus experienced residents (23.3 ± 5.2 vs 34.1 ± 6.0, t = .001). Mean global quality scores (out of 45) were similarly lower for novice residents (25.6 ± 4.7 vs 35.9 ± 7.6, t = .006). Interclass correlation coefficients were .98 (95% confidence interval, .96–.99) for structured assessment and .93 (95% confidence interval, .83–.97) for global quality scales. Cronbach ⍺ coefficients for internal consistency were .85 for structured assessment and .96 for global quality assessment scales.
Conclusions |
SAFE-OR shows significant construct validity, excellent interrater reliability, and high internal consistency. This tool will allow educators to objectively evaluate the quality of trainee operative reports and provide a mechanism for implementing, monitoring, and refining curriculum for dictation skills.
Le texte complet de cet article est disponible en PDF.Keywords : Operative, Dictation, Structured assessment, Evaluation
Plan
Vol 195 - N° 1
P. 24-29 - janvier 2008 Retour au numéro
Article précédent
- Assessing the teaching of procedural skills: can cognitive task analysis add to our traditional teaching methods?
- Maura E. Sullivan, Adrian Ortega, Nir Wasserberg, Howard Kaufman, Julie Nyquist, Richard Clark
- Enlarged parathyroid glands discovered in normocalcemic patients during thyroid surgery
- Bassam Abboud, Ghassan Sleilaty, Carla Braidy, Claude Ghorra, Gerard Abadjian, Cyril Tohme, Roger Noun, Riad Sarkis
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?