S'abonner

Validity Evidence for a Novel, Comprehensive Bag–Mask Ventilation Assessment Tool - 16/06/22

Doi : 10.1016/j.jpeds.2022.02.017 
Allison M. Whalen, MD 1, , Matthew H. Merves, MD 2, Priyanka Kharayat, MD, MBBS 3, James S. Barry, MD 4, Kristen M. Glass, MD 5, Robert A. Berg, MD 6, 7, Taylor Sawyer, DO, MEd, CHSE-A 8, Vinay Nadkarni, MD, MS 6, 7, Donald L. Boyer, MD, MSEd 6, 7, Akira Nishisaki, MD, MSCE 6, 7
1 Division of Pediatric Critical Care Medicine, Department of Pediatrics, Medical University of South Carolina, Charleston, SC 
2 Division of Neonatology, Department of Pediatrics, University of Arkansas for Medical Sciences and Arkansas Children's Hospital, Little Rock, AR 
3 Department of Pediatrics, Albert Einstein Medical Center, Philadelphia, PA 
4 Section of Neonatology, Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO 
5 Division of Neonatal-Perinatal Medicine, Department of Pediatrics, Penn State College of Medicine, Milton S. Hershey Medical Center, Hershey, PA 
6 Division of Critical Care Medicine, Children's Hospital of Philadelphia, Philadelphia, PA 
7 Department of Anesthesiology & Critical Care, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA 
8 Division of Neonatology, Department of Pediatrics, University of Washington School of Medicine, Seattle Children's Hospital, Seattle, WA 

Reprint requests: Allison Whalen, MD, Pediatric Critical Care Medicine, Medical University of South Carolina Children's Hospital, 125 Doughty St, MSC 917, Charleston, SC 2942.Pediatric Critical Care MedicineMedical University of South Carolina Children's Hospital125 Doughty St, MSC 917CharlestonSC2942

Abstract

Objective

To develop a comprehensive competency assessment tool for pediatric bag–mask ventilation (pBMV) and demonstrate multidimensional validity evidence for this tool.

Study design

A novel pBMV assessment tool was developed consisting of 3 components: a 22-item-based checklist (trichotomized response), global rating scale (GRS, 5-point), and entrustment assessment (4-point). Participants' performance in a realistic simulation scenario was video-recorded and assessed by blinded raters. Multidimensional validity evidence for procedural assessment, including evidence for content, response-process, internal structure, and relation to other variables, was assessed. The scores of each scale were compared with training level. Item-based checklist scores also were correlated with GRS and entrustment scores.

Results

Fifty-eight participants (9 medical students, 10 pediatric residents, 18 critical care/neonatology fellows, 21 critical care/neonatology attendings) were evaluated. The pBMV tool was supported by high internal consistency (Cronbach α = 0.867). Inter-rater reliability for the item-based checklist component was acceptable (r = 0.65, P < .0001). The item-based checklist scores differentiated between medical students and other providers (P < .0001), but not by other trainee level. GRS and entrustment scores significantly differentiated between training levels (P < .001). Correlation between skill item-based checklist and GRS was r = 0.489 (P = .0001) and between item-based checklist and entrustment score was r = 0.52 (P < .001). This moderate correlation suggested each component measures pBMV skills differently. The GRS and entrustment scores demonstrated moderate inter-rater reliability (0.42 and 0.46).

Conclusions

We established evidence of multidimensional validity for a novel entrustment-based pBMV competence assessment tool, incorporating global and entrustment-based assessments. This comprehensive tool can provide learner feedback and aid in entrustment decisions as learners progress through training.

Le texte complet de cet article est disponible en PDF.

Keywords : simulation, medical education, checklist, assessment, workplace-based assessment, procedural competency

Abbreviations : BMV, EPA, GRS, INSPIRE, pBMV


Plan


 Supported by a Section on Critical Care Small Projects Grant (A.W., 2017) from the American Academy of Pediatrics. V.N. and A.N. are supported by the Agency for Healthcare Research and Quality (AHRQ R03HS021583, R18 HS022464, R18HS024511). V.N. is supported by the Endowed Chair in Critical Care Medicine at Children’s Hospital of Philadelphia. The Children's Hospital of Philadelphia is supported by Nihon Kohden, Inc, for the development of Respiratory Function Monitor. D.B. receives funding from the University of Pennsylvania Graduate School of Education. The other authors have indicated they have no financial relationships relevant to this article to disclose.
 Portions of this study were presented as an oral abstract during the 49th Critical Care Congress of the Society of Critical Care Medicine, February 16-19, 2020, Orlando, Florida.


© 2022  Elsevier Inc. Tous droits réservés.
Ajouter à ma bibliothèque Retirer de ma bibliothèque Imprimer
Export

    Export citations

  • Fichier

  • Contenu

Vol 245

P. 165 - juin 2022 Retour au numéro
Article précédent Article précédent
  • Pediatric Prescriptions of Proton Pump Inhibitors in France (2009-2019): A Time-Series Analysis of Trends and Practice Guidelines Impact
  • Shuai Yang, Nhung T.H. Trinh, Martin Chalumeau, Florentia Kaguelidou, Frank M. Ruemmele, Dejan Milic, Magali Lemaitre, Jérémie F. Cohen, Marion Taine
| Article suivant Article suivant
  • Relationship Between Postnatal Pulmonary Arterial Pressure and Altered Diastolic Function in Neonates with Down Syndrome
  • Aisling Smith, Neidin Bussmann, Colm Breatnach, Philip T. Levy, Eleanor Molloy, Jan Miletin, Anna Curley, Naomi McCallion, Orla Franklin, Afif F. El-Khuffash

Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.

Déjà abonné à cette revue ?

Elsevier s'engage à rendre ses eBooks accessibles et à se conformer aux lois applicables. Compte tenu de notre vaste bibliothèque de titres, il existe des cas où rendre un livre électronique entièrement accessible présente des défis uniques et l'inclusion de fonctionnalités complètes pourrait transformer sa nature au point de ne plus servir son objectif principal ou d'entraîner un fardeau disproportionné pour l'éditeur. Par conséquent, l'accessibilité de cet eBook peut être limitée. Voir plus

Mon compte


Plateformes Elsevier Masson

Déclaration CNIL

EM-CONSULTE.COM est déclaré à la CNIL, déclaration n° 1286925.

En application de la loi nº78-17 du 6 janvier 1978 relative à l'informatique, aux fichiers et aux libertés, vous disposez des droits d'opposition (art.26 de la loi), d'accès (art.34 à 38 de la loi), et de rectification (art.36 de la loi) des données vous concernant. Ainsi, vous pouvez exiger que soient rectifiées, complétées, clarifiées, mises à jour ou effacées les informations vous concernant qui sont inexactes, incomplètes, équivoques, périmées ou dont la collecte ou l'utilisation ou la conservation est interdite.
Les informations personnelles concernant les visiteurs de notre site, y compris leur identité, sont confidentielles.
Le responsable du site s'engage sur l'honneur à respecter les conditions légales de confidentialité applicables en France et à ne pas divulguer ces informations à des tiers.


Tout le contenu de ce site: Copyright © 2026 Elsevier, ses concédants de licence et ses contributeurs. Tout les droits sont réservés, y compris ceux relatifs à l'exploration de textes et de données, a la formation en IA et aux technologies similaires. Pour tout contenu en libre accès, les conditions de licence Creative Commons s'appliquent.