Artificial intelligence based assessment of minimally invasive surgical skills using standardised objective metrics – A narrative review - 10/02/25
, C. Wijeweera a, Z. Ong a, T. Preda b, c, T. Carney d, M. Wilson a, d, V. Preda aAbstract |
Introduction |
Many studies display significant heterogeneity in the reliability of artificial intelligence (AI) assessment of minimally invasive surgical (MIS) skills. Our objective is to investigate whether AI systems utilising standardised objective metrics (SOMs) as the basis of skill assessment can provide a clearer understanding of the current state of such technology.
Methods |
We systematically searched Medline, Embase, Scopus, CENTRAL and Web of Science from March 2023 to September 2023. Results were compiled as a narrative review.
Results |
Twenty-four citations were analysed. Overall accuracy of AI systems in predicting overall SOM score of a procedure ranged from 63 % to 100 %. The most frequently used SOM by AI algorithms were Objective Structured Assessment of Technical Skills (OSATS) (8/24) and Global Evaluative Assessment of Robotic Skills (GEARS) (8/24).
Conclusions |
Stratifying for AI studies which employed SOMs to assess surgical skill did not reduce heterogeneity of reported reliability. Our study identifies key issues within the current literature, which, once addressed, could allow more meaningful comparisons between studies.
Le texte complet de cet article est disponible en PDF.Highlights |
• | AI minimally invasive surgical proficiency assessment is applicable to a wide range of disciplines/procedures. |
• | Stratifying studies that used only standardised metrics to assess surgical skill with AI did not improve result comparability. |
• | Studies should focus assessing proficiency on key procedural steps using computer simulations or real-life procedures. |
• | Procedure specific standardised objective metrics will likely produce more precise and relevant feedback from an AI system. |
Keywords : Artificial intelligence, Surgical education, Minimally invasive surgery, Standardised objective metrics, Remote learning
Plan
Vol 241
Article 116074- mars 2025 Retour au numéro
Article précédent
- Effects of the COVID-19 pandemic on the providers of oncological abdominal surgery services– a scoping review
- Murielle Madi, Marcus Heise, Lisa Rieder, Elke Mattern, Ulrich Ronellenfitsch, Anke Steckelberg
- The criticality of reasonable accommodations: A scoping review revealing gaps in care for patients with blindness and low vision
- Grace Keegan, John-Ross Rizzo, Megan A. Morris, Kathie-Ann Joseph
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?