Using artificial intelligence for automated assessment of point-of-care ultrasound (POCUS) skills in emergency medicine - 16/03/26
, Roger D. Dias a, b, 1, Rayan Harari b, c, Paulo Borges a, b, Robson J. Verly a, b, Madeline Schwid d, Chanel E. Fischetti b, g, Lao-Tzu Allan-Blitz b, e, Daniel Heron f, Calvin K. Huang b, g, Andrew J. Goldsmith f, hAbstract |
Background |
This study aimed to demonstrate the feasibility of using computer vision (CV) to unobtrusively extract body motion metrics from videos of emergency medicine (EM) clinicians, and gather validity evidence of these metrics to differentiate POCUS skills between novice and experts, as well as to capture skills gained over time.
Methods |
Prospective cohort study including novice and expert EM clinicians performing echocardiogram (ECHO) and focused assessment with sonography for trauma (FAST) exams on a live simulated patient. Expert observers provided objective structured clinical examination (OSCE) scores (numerical ratings on a scale from 1 to 100), and sonographers' hands and head motion metrics (path length, speed, acceleration, jerk, and smoothness) were extracted via CV using 2-dimensional videos. Data points were captured at baseline, and for novices at baseline and after 12–15 months of residency training.
Results |
CV achieved high detection rates (99.52% ECHO, 98.70% FAST). At baseline, experts demonstrated superior OSCE scores (ECHO: 98.6 ± 2.1 vs 63.4 ± 17.0; FAST: 99.2 ± 1.5 vs 68.9 ± 17.7, p < 0.001) and faster task completion (101.8 ± 44.7 vs 240.3 ± 84.1 s, p < 0.001). Experts exhibited smoother hand movements (left hand smoothness: −129.3 ± 47.6 vs −241.3 ± 64.6, p < 0.001) and reduced total path lengths. After 12–15 months of training, novices showed significant improvements in OSCE scores (ECHO: 85.3 ± 10.3; FAST: 84.8 ± 6.5) and task efficiency (134.0 ± 35.6 s), with improvements in motion smoothness and reduced path lengths ( p < 0.001). Motion metrics strongly correlated with OSCE scores ( r = 0.455–0.783) and task completion time ( r = 0.491–0.951).
Conclusions |
CV successfully extracted objective motion metrics that differentiated POCUS skill levels between novices and experts and captured skill development over time. This approach offers a scalable, unobtrusive method for objective POCUS assessment, while supporting competency-based medical education frameworks.
Le texte complet de cet article est disponible en PDF.Highlights |
• | Computer vision can unobtrusively extract body motion data to be used for competency assessments in procedural training. |
• | Motion metrics obtained using computer vision differentiate skill level in point-of-care ultrasound image acquisition. |
• | Experts exhibit faster task completion, smoother hand motions, and reduced hand motion path lengths compared to novices. |
• | Motion metrics strongly correlate with current gold-standard competency assessments in point-of-care ultrasound training. |
Keywords : Point-of-care ultrasound, POCUS, Computer vision, Artificial intelligence, Competency, Education
Plan
Vol 103
P. 57-64 - mai 2026 Retour au numéro
Article précédent
- Training level and analgesic outcomes of ultrasound-guided nerve blocks in the emergency department: An analysis from the NURVE block registry
- Michael Macias, Lachlan Driver, Matthew Riscinti, Andrea Dreyfuss, Christopher Fung, Leland Perice, Joseph Brown, S. Zan Jafry, Arun Nagdev, Andrew Goldsmith
- Vascular access by paramedics during cardiopulmonary resuscitation in out-of-hospital cardiac arrest: A retrospective study of insertion success rates and survival outcomes of intravenous versus intraosseous route
- Tan N. Doan, Stephen Rashford, Adam Rolley, Brendan Schultz, Emma Bosley
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?