Digital Impact Factor: A Quality Index for Educational Blogs and Podcasts in Emergency Medicine and Critical Care - 20/06/23
, Mina Phipps b, Teresa M. Chan, MD, MHPE c, Brent Thoma, MD, MSc d, Christopher J. Nash, MD, EdM e, Yusuf Yilmaz, PhD f, g, David Chen, BMSc h, Shuhan He, MD i, Michael A. Gisondi, MD jAbstract |
Study objective |
Given the popularity of educational blogs and podcasts in medicine, learners and educators need tools to identify trusted and impactful sites. The Social Media Index was a multi-sourced formula to rank the effect of emergency medicine and critical care blogs. In 2022, a key data point for the Social Media Index became unavailable. This bibliometric study aimed to develop a new measure, the Digital Impact Factor, as a replacement.
Methods |
The Digital Impact Factor incorporated modern measures of website authority and reach. This formula was applied to a cross-sectional study of active emergency medicine and critical care blogs and podcasts. For each website, we generated a Digital Impact Factor score based on Ahrefs Domain Rating and the follower count of the websites’ pages from 8 social media platforms. A series of Spearman correlations provided evidence of association by comparing a rank-ordered list to rank lists derived from the Social Media Index over the last 5 years. The Bland-Altman analysis assessed for agreement.
Results |
The authors identified 88 relevant websites with a median Ahrefs Domain Rating of 28 (range 0 to 71, maximum 100) and total social media followership count across 8 platforms of 1,828,557. The Domain Rating and individual social media followership scores were normalized based on the highest recorded values to yield the Digital Impact Factor (median 4.57; range 0.02 to 9.50, maximum 10). The correlation between the 2022 Digital Impact Factor and the 2021 Social Media Index was 0.94 (95% confidence interval 0.89 to 0.97; p<.001; n=41 rankings correlated), suggesting that they measure similar constructs. The Bland-Altman plot also demonstrated fair agreement between the 2 scores.
Conclusion |
The Digital Impact Factor is a measure of the relative effect of educational blogs and podcasts within emergency medicine and critical care.
Le texte complet de cet article est disponible en PDF.Plan
| Please see page 56 for the Editor’s Capsule Summary of this article. |
|
| Supervising editor: N. Seth Trueger, MD, MPH. Specific detailed information about possible conflicts of interest for individual editors is available at editors. |
|
| Author contributions: ML, MP, TMC, and MAG conceived the study and designed the trial. ML, MP, and MAG performed and supervised data collection. DC, SH, BT, and YY provided technical advice on data analytics in business and education. TMC and CJN provided statistical advice on study design. All authors participated in the drafting of the manuscript, contributed substantially to its revision, approved the final version of the manuscript, and agreed to be accountable for their contributed work. ML takes responsibility for the paper as a whole. |
|
| Authorship: All authors attest to meeting the four ICMJE.org authorship criteria: (1) Substantial contributions to the conception or design of the work; or the acquisition, analysis, or interpretation of data for the work; AND (2) Drafting the work or revising it critically for important intellectual content; AND (3) Final approval of the version to be published; AND (4) Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. |
|
| Funding and support: By Annals policy, all authors are required to disclose any and all commercial, financial, and other relationships in any way related to the subject of this article as per ICMJE conflict of interest guidelines (see www.icmje.org). MP was funded by the IntroSems Plus program at Stanford University as a research assistant to collect data and help design the Digital Scholarship Impact Factor formula. YY is funded by the Scientific and Technological Research Council of Turkey Postdoctoral Fellowship grant. |
|
| ML is the founder and editor in chief of the educational blog Academic Life in Emergency Medicine (ALiEM), where the Social Media Index annual rank list was hosted. |
|
| TMC is the cofounder of the ALiEM Faculty Incubator and Chief Strategy Officer for the blog organization CanadiEM. She also reports honoraria from McMaster University for her education research work with the McMaster Education Research, Innovation, and Theory group and an administrative stipend for her role of associate dean via the McMaster Faculty of Health Sciences Office of Continuing Professional Development. She discloses that she has received various unrelated research grants, teaching honoraria, and speakership fees from academic institutions (Baylor University/Texas Children’s Hospital, Catholic University of Korea, Taiwan Veteran’s General Hospital, Prince of Songkla University, Harvard Medical School, International Association of Medical Sciences Educators, Ontario College of Family Physicians, Northern Ontario School of Medicine, University of British Columbia, University of Northern British Columbia, and Holland Bloorview), nonprofit organizations (PSI Foundation), physician organizations (Association of American Medical Colleges, Canadian Association of Emergency Physicians, Society of Academic Emergency Medicine, the Royal College of Physicians and Surgeons of Canada, and Medical Council of Canada), and governmental sources (Government of Ontario and Virtual Learning Strategy eCampus Ontario program). |
|
| BT is the Chief Executive Officer for the blog organization CanadiEM. In the past 2 years, he has received payments for teaching, research, and administrative work from the University of Saskatchewan College of Medicine, payments for teaching and administrative work from the Royal College of Physicians and Surgeons of Canada, honoraria from Harvard Medical School, the New England Journal of Medicine, the University of Cincinnati Children’s Hospital, and NYC Health + Hospitals, and research grant funding from the Government of Ontario and the Canadian Association of Emergency Physicians. |
|
| CJN is the Associate Director of Growth for ALiEM and the ALiEM University Chief Technology Officer. |
|
| SH is the Cofounder and Executive Board Director for GetUsPPE.org (unpaid) and the Founder and Executive Board Member of Conduct Science Inc. He is also a committee member of the American College of Emergency Physician Supply Chain Task Force committee. He has research funding from the Foundation for Opioid Response Efforts and obtains personal fees from Withings Inc, Boston Globe, American College of Emergency Physicians, Maze Eng Inc, Curative Medical Associates. He is on the advisory board for COVID Act Now and Safeter App. |
|
| MAG was the podcast host for the ALiEM EM Match Advice series. |
|
| Readers: click on the link to go directly to a survey in which you can provide VRX6LGF to Annals on this particular article. |
|
| A podcast for this article is available at www.annemergmed.com. |
Vol 82 - N° 1
P. 55-65 - juillet 2023 Retour au numéro
Article précédent
- The Knowledge Gap: Mentorship in Emergency Medicine Residency
- Julia Sobel, Stephen R. Hayden, Gabriel Wardi
- American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2022-2023)
- Theodore J. Gaeta, Yvette Calderon, Felix K. Ankel, Marianne Gausche-Hill, Diane L. Gorgas, Deepi G. Goyal, Robert G. Purosky, Andrew Trotter, Mary M. Johnston
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?