Reliability of a faculty evaluated scoring system for anesthesiology resident applicants (Original Investigation) - 14/05/16

Abstract |
Study Objective |
To assess reliability and reproducibility of a recently instituted anesthesiology resident applicant interview scoring system at our own institution.
Design |
Retrospective evaluation of 2 years of interview data with a newly implemented scoring system using randomly assigned interviewing faculty.
Setting |
Interview scoring evaluations were completed as standard practice in a large academic anesthesiology department.
Subjects |
All anesthesiology resident applicants interviewed over the 2013/14 and 2014/15 seasons by a stable cohort of faculty interviewers. Data collection blinded for both interviewers and interviewees.
Interventions |
None for purposes of study – collation of blinded data already used as standard practice during interview process and analysis.
Measurements |
None specific to study.
Main Results |
Good inter-rater faculty reliability of interview scoring (day-of) and excellent inter-faculty reliability of application review (pre-interview).
Conclusions |
Development of a department-specific interview scoring system including many elements beyond traditional standardized tests shows good-excellent reliability of faculty scoring of both the interview itself (including non-technical skills) and the application resume.
Le texte complet de cet article est disponible en PDF.Highlights |
• | Evaluation of anesthesiology resident applicants is challenging. |
• | We describe our departmental review process for the file application and interview. |
• | Objective scoring is done by 2 randomly assigned faculty. |
• | Inter-rater reproducibility was excellent between faculty. |
• | Reliability and reproducibility of our scoring system are reassuring. |
Keywords : Resident, Applicant, Interview, Faculty, Reproducibility, Reliability
Plan
| ☆ | Disclosure: No authors have any conflicts of interest and all support was provided solely by the home department of anesthesiology of the authors. |
| ☆☆ | Portions of these data were presented as abstracts at the American Society of Anesthesiologists Annual Meeting, New Orleans 2014 (A 2250, A 2251). |
Vol 31
P. 131-136 - juin 2016 Retour au numéroBienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?
