Comparison between artificial intelligence solution and radiologist for the detection of pelvic, hip and extremity fractures on radiographs in adult using CT as standard of reference - 14/01/25
, Djamel Dabli a, 1, Raphaël Lonjon a, Chris Serrand b, Fehmi Snene a, Fayssal Trad a, Fabien de Oliveira a, Jean-Paul Beregi a, Joël Greffier a
Bienvenue sur EM-consulte, la référence des professionnels de santé.
Article gratuit.
Connectez-vous pour en bénéficier!
Highlights |
• | The diagnostic performance of an artificial intelligence (AI) solution for the detection of pelvic, hip and extremity fractures on radiographs in adult was compared with that of a radiologist. |
• | The AI solution achieved a sensitivity of 82 % and a specificity of 69 % which were both significantly lower than those obtained by the radiologist (92 % and 88 %, respectively). |
• | The presence of a substantial number of false negative findings with the AI solution underscores the critical role of the radiologist in the diagnosis of these fractures in adult on radiographs. |
Abstract |
Purpose |
The purpose of this study was to compare the diagnostic performance of an artificial intelligence (AI) solution for the detection of fractures of pelvic, proximal femur or extremity fractures in adults with radiologist interpretation of radiographs, using standard dose CT examination as the standard of reference.
Materials and methods |
This retrospective study included 94 adult patients with suspected bone fractures who underwent a standard dose CT examination and radiographs of the pelvis and/or hip and extremities at our institution between January 2022 and August 2023. For all patients, an AI solution was used retrospectively on the radiographs to detect and localize bone fractures of the pelvis and/or hip and extremities. Results of the AI solution were compared to the reading of each radiograph by a radiologist using McNemar test. The results of standard dose CT examination as interpreted by a senior radiologist were used as the standard of reference.
Result |
A total of 94 patients (63 women; mean age, 56.4 ± 22.5 [standard deviation] years) were included. Forty-seven patients had at least one fracture, and a total of 71 fractures were deemed present using the standard of reference (25 hand/wrist, 16 pelvis, 30 foot/ankle). Using the standard of reference, the analysis of radiographs by the AI solution resulted in 58 true positive, 13 false negative, 33 true negative and 15 false positive findings, yielding 82 % sensitivity (58/71; 95 % confidence interval [CI]: 71–89 %), 69 % specificity (33/48; 95 % CI: 55–80 %), and 76 % accuracy (91/119; 95 % CI: 69–84 %). Using the standard of reference, the reading of the radiologist resulted in 65 true positive, 6 false negative, 42 true negative and 6 false positive findings, yielding 92 % sensitivity (65/71; 95 % CI: 82–96 %), 88 % specificity (42/48; 95 % CI: 75–94 %), and 90 % accuracy (107/119; 95 % CI: 85–95 %). The radiologist outperformed the AI solution in terms of sensitivity ( P = 0.045), specificity ( P = 0.016), and accuracy ( P < 0.001).
Conclusion |
In this study, the radiologist outperformed the AI solution for the diagnosis of pelvic, hip and extremity fractures of the using radiographs. This raises the question of whether a strong standard of reference for evaluating AI solutions should be used in future studies comparing AI and human reading in fracture detection using radiographs.
Le texte complet de cet article est disponible en PDF.Keywords : Artificial intelligence, Computed tomography, Emergency radiology, Fracture, Radiograph
Abbreviations : AI, CI, CT, SD, ULD
Plan
Vol 106 - N° 1
P. 22-27 - janvier 2025 Retour au numéro
Article précédent
- Added value of artificial intelligence solutions for arterial stenosis detection on head and neck CT angiography: A randomized crossover multi-reader multi-case study
- Kunhua Li, Yang Yang, Yongwei Yang, Qingrun Li, Lanqian Jiao, Ting Chen, Dajing Guo
- Radiomics machine learning algorithm facilitates detection of small pancreatic neuroendocrine tumors on CT
- Felipe Lopez-Ramirez, Sahar Soleimani, Javad R. Azadi, Sheila Sheth, Satomi Kawamoto, Ammar A. Javed, Florent Tixier, Ralph H. Hruban, Elliot K. Fishman, Linda C. Chu
Bienvenue sur EM-consulte, la référence des professionnels de santé.