Reproducibility of machine learning models for paroxysmal atrial fibrillation onset forecast - 31/12/22
Résumé |
Introduction |
Atrial fibrillation (AF) is the most common heart arrhythmia. Paroxysmal AF onset forecast is a more complex task than screening AF. Published methods using the Physionet AFPDB database show excellent results, suggesting that AF episodes for is possible by implementing machine learning (ML) models using heart rate variability (HRV) parameters.
Objective |
Reproduce previously obtained results by published studies using the Physionet database and a larger database of unselected real-life patients.
Method |
We searched the literature for all articles on paroxysmal AF episodes forecast. We analysed in depth the methodology of 3 recent studies using ML methods, to replicate their results. We screened our ECG Holter monitoring database of 11,833 Holters to find those with paroxysmal AF episodes recorded. A total of 214 Holters with paroxysmal AF were labelled. We developed two ML models (deep neural network and a random forest model) for AF forecast using 13 HRV parameters. We compared performances of published models and our models using the Physionet database and our real-life database of patients.
Results |
We found 21 publications dedicated to AF episodes onset forecast. They are showing exciting results culminating in sensitivities of 98%, specificity of 95% and accuracy of 98%. Using each model description available in the publications, we could not reach the published performances on the Physionet database. In addition, our models obtained a lower sensitivity of 84% for a specificity of 49% on the Physionet database (Fig. 1). The results are similar to the sensitivity of 80.1% for a specificity of 52.8% we obtained on our larger database.
Conclusion |
ML models need to be more detailed if the reported results must be reproducible. Progress must still be made before the clinical use of algorithms that can anticipate paroxysmal AF. The use of larger databases is mandatory for this type of prediction.
Le texte complet de cet article est disponible en PDF.Plan
Vol 15 - N° 1
P. 172-173 - janvier 2023 Retour au numéroBienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?

