ChatGPT versus Google Search-linked responses to surgical and fertility-related endometriosis questions: a cross-sectional content analysis - 19/11/26
, Sharon Cote c, Farr Nezhat cABSTRACT |
Objective |
To compare guideline concordance, safety, actionability, and readability of ChatGPT and Google Search-linked responses to patient-facing surgical and fertility-related endometriosis questions.
Methods |
We performed a cross-sectional comparative digital content analysis of 40 prespecified questions across diagnosis/imaging, minimally invasive surgery, deep organ-involving disease, and fertility/ovarian reserve. For each question, one ChatGPT response and one Google Search-linked response archived on May 31, 2026 were scored independently by two physicians with platform and source identifiers concealed; readability was assessed using Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease (FRES), and Simple Measure of Gobbledygook (SMOG).
Results |
Eighty responses were analyzed. ChatGPT responses were longer than Google Search-linked responses (52.6 ± 3.9 vs 38.6 ± 4.0 words). ChatGPT had a higher overall clinical quality score (4.91 ± 0.11 vs 4.53 ± 0.23; paired mean difference, 0.38; 95% CI, 0.32 to 0.45), driven by completeness (0.94; 95% CI, 0.78 to 1.10) and actionability (0.60; 95% CI, 0.47 to 0.73). Safety scores were similarly high, and no response was judged harmful or misleading. Mean grade-level estimates for both platforms exceeded the sixth-grade reference benchmark.
Conclusion |
In this controlled set of surgical and fertility-related endometriosis questions, ChatGPT responses received higher completeness and actionability ratings than Google Search-linked answers, with similarly high safety ratings. Both platforms had mean grade-level estimates above the sixth-grade reference benchmark, supporting clinician-reviewed educational use and further assessment of patient comprehension.
Le texte complet de cet article est disponible en PDF.Keywords : digital health, fertility preservation, health literacy, large language models, minimally invasive surgery, ovarian reserve
Abbreviations : AMH, CI, FKGL, FRES, ICC, IVF, LLM, SMOG
Plan
Bienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?
