Using item analysis to evaluate hand hygiene self-assessments at Alberta health services - 20/05/23
Highlights |
• | Lack of research on assessing hand hygiene assessments for reviewer training. |
• | Item analysis highlighted need to improve hand hygiene assessments. |
• | This framework for evaluating validity and reliability is more robust. |
• | This framework can be adapted for assessing other educational assessments. |
Abstract |
Background |
It is important to evaluate the quality of assessments used in education as the evaluation can identify poorly worded questions, or questions which are not contributing to the validity or reliability of the test. The objective of this study was to perform an item analysis on the hand hygiene self-assessments used at Alberta Health Services to determine the assessments’ validity, reliability, and to highlight questions that required rewording or removal.
Methods |
The sample included all first completed attempts between April 2018 and December 2020. Components of the analysis included item difficulty, item discrimination, B-index, point biserial correlation, overall discrimination score, distractor efficiency, and Cronbach's alpha.
Results |
A total of 650 health care workers completed the assessment. The average item difficulty was 0.76 (0.32-0.99), average discrimination index was 0.23 (0.02-0.65), average B-index was 0.15 (0.02-0.45), and average point biserial correlation was 0.26 (0.07-0.54). Seventeen of 45 items had an overall discrimination score greater than 7 of 9 and 20 of 21 (95%) multiple choice questions had at least 1 non-functioning distractor. The self-assessment had an overall Cronbach's alpha value of 0.68.
Conclusion |
The item analysis provided robust evidence for improving the validity and reliability of the self-assessment. The steps performed in this item analysis can be useful for educators interested in improving assessments that include different question types.
Le texte complet de cet article est disponible en PDF.Key Words : Educational assessments, Validity, Reliability, Hand hygiene reviews
Plan
| Conflicts of interest: None to report. |
Vol 51 - N° 6
P. 683-686 - juin 2023 Retour au numéro
Article précédent
- The impact of healthcare-associated infections on mortality in ICU: A prospective study in Asia, Africa, Eastern Europe, Latin America, and the Middle East
- Victor Daniel Rosenthal, Ruijie Yin, Yawen Lu, Camilla Rodrigues, Sheila Nainan Myatra, Mohit Kharbanda, Sandra Liliana Valderrama-Beltran, Yatin Mehta, Mohammad Abdellatif Daboor, Subhash Kumar Todi, Guadalupe Aguirre-Avalos, Ertugrul Guclu, Chin Seng Gan, Luisa Fernanda Jiménez-Alvarez, Rajesh Chawla, Sona Hlinkova, Rajalakshmi Arjun, Hala Mounir Agha, Maria Adelia Zuniga-Chavarria, Narangarav Davaadagva, Mat Nor Mohd Basri, Katherine Gomez-Nieto, Daisy Aguilar-de-Moros, Chian-Wern Tai, Alejandro Sassoe-Gonzalez, Lina Alejandra Aguilar-Moreno, Kavita Sandhu, Jarosław Janc, Mary Cruz Aleman-Bocanegra, Dincer Yildizdas, Yuliana Andrea Cano-Medina, Maria Isabel Villegas-Mota, Abeer Aly Omar, Wieslawa Duszynska, Souad BelKebir, Amani Ali El-Kholy, Safaa Abdulaziz Alkhawaja, George Horhat Florin, Eduardo Alexandrino Medeiros, Lili Tao, Ziad A. Memish, Zhilin Jin
- Lessons learned from a failed implementation: Effective communication with patients in transmission-based precautions
- Luize F. Juskevicius, Reginaldo A. Luz, Adriana M.da Silva Felix, Stephen Timmons, Maria Clara Padoveze
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?