Development and initial validation of a video-based peroral endoscopic myotomy assessment tool - 16/01/24
, Peter V. Draganov, MD 2, Heiko Pohl, MD, MPH 3, 4, Hiroyuki Aihara, MD, PhD 5, Thurarshen Jeyalingam, MD 6, Mouen Khashab, MD 7, Nanlong Liu, MD 8, Muhammad K. Hasan, MD 1, Salmaan Jawaid, MD 9, Mohamed Othman, MD 9, Mohamed Al-Haddad, MD 10, John M. DeWitt, MD 10, Joseph R. Triggs, MD 11, Andrew Y. Wang, MD 12, Robert Bechara, MD 13, Amrita Sethi, MD 14, Ryan Law, MD 15, Aziz A. Aadam, MD 16, Nikhil Kumta, MD 17, Neil Sharma, MD 18, Maham Hayat, MD 1, YiYang Zhang, MS 19, Fanchao Yi, MS 19, B. Joseph Elmunzer, MD, MSc 20Abstract |
Background and Aims |
Video analysis has emerged as a potential strategy for performance assessment and improvement. We aimed to develop a video-based skill assessment tool for peroral endoscopic myotomy (POEM).
Methods |
POEM was deconstructed into basic procedural components through video analysis by an expert panel. A modified Delphi approach and 2 validation exercises were conducted to refine the POEM assessment tool (POEMAT). Twelve assessors used the final POEMAT version to grade 10 videos. Fully crossed generalizability (G) studies investigated the contributions of assessors, endoscopists’ performance, and technical elements to reliability. G coefficients below .5 were considered unreliable, between .5 and .7 as modestly reliable, and above .7 as indicative of satisfactory reliability.
Results |
After task deconstruction, discussions, and the modified Delphi process, the final POEMAT comprised 9 technical elements. G analysis showed low variance for endoscopist performance (.8%-24.9%) and high interrater variability (range, 63.2%-90.1%). The G score was moderately reliable (≥.60) for “submucosal tunneling” and “myotomy” and satisfactorily reliable (≥.70) for “active hemostasis” and “mucosal closure.”
Conclusions |
We developed and established initial content and response process validity evidence for the POEMAT. Future steps include appraisal of the tool using a wider range of POEM videos to establish and improve the discriminative validity of this tool.
Le texte complet de cet article est disponible en PDF.Graphical abstract |
Abbreviations : D study, G study, POEM, POEMAT
Plan
| DIVERSITY, EQUITY, AND INCLUSION: We worked to ensure gender balance in the recruitment of human subjects. We worked to ensure ethnic or other types of diversity in the recruitment of human subjects. We worked to ensure that the language of the study questionnaires reflected inclusion. We worked to ensure sex balance in the selection of non-human subjects. One or more of the authors of this paper self-identifies as an under-represented gender minority in science. One or more of the authors of this paper self-identifies as an under-represented ethnic minority in science. While citing references scientifically relevant for this work, we actively worked to promote gender balance in our reference list. |
Vol 99 - N° 2
P. 177-185 - février 2024 Retour au numéro
Article précédent
- Acidification of the esophagus in post-peroral endoscopic myotomy achalasia patients: all that glitters is not gold
- Fauze Maluf-Filho
- New endoscopic closure technique, “internal traction–assisted suspended closure,” for GI defect closure: a pilot study (with video)
- Yaoyao Gong, Jue Wang, Tianyin Chen, Jing Cheng, Keyi Guo, Wei Su, Pinghong Zhou, Jianwei Hu
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?