Authors: Gondode PG et al.
A & A Practice 19(11):e02070, November 2025.
Summary
This comparative study evaluated the accuracy, completeness, readability, emotional tone, and myth-debunking ability of patient education materials (PEMs) about Complex Regional Pain Syndrome (CRPS) generated by three AI chatbots—ChatGPT, Google Gemini, and Meta Llama—compared with traditional online content from Cleveland Clinic and Mayo Clinic. CRPS represents a challenging chronic pain condition, and patient education is critical for reducing misconceptions and improving coping strategies.
Five pain experts rated the PEMs on accuracy and completeness using a 1–5 Likert scale, while readability indices and sentiment analysis assessed clarity and tone. The AI systems’ ability to debunk 15 common CRPS myths was evaluated using sensitivity and specificity metrics.
Cleveland Clinic materials had the highest accuracy and completeness ratings (4.8 ± 0.40), outperforming both Gemini and Llama. Gemini produced the most readable PEMs (Flesch score 62) and the most positive emotional tone, though it had lower specificity in debunking myths (66.7%). ChatGPT demonstrated perfect specificity (100%)—meaning it did not incorrectly validate any myths—highlighting stronger reliability in myth-detection tasks. Traditional PEMs overall remained more complete than AI-generated ones, suggesting established institutions still provide the most comprehensive educational content. Nonetheless, AI chatbots showed substantial promise, especially in accessibility and clarity, positioning them as useful complementary tools.
Key Points
• CRPS patient education content from Cleveland Clinic scored highest for accuracy and completeness.
• Gemini produced the most readable PEMs but showed lower specificity when debunking myths.
• ChatGPT demonstrated 100% specificity for myth debunking, the strongest of all AI systems tested.
• AI-generated materials were generally readable and accurate but less comprehensive than traditional sources.
• AI tools can complement—but not yet replace—expert-vetted patient education resources.
Thank you for allowing us to use this article from A & A Practice.