AI Answers About Macular Degeneration: Model Comparison
Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.
AI Answers About Macular Degeneration: Model Comparison
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.
Age-related macular degeneration (AMD) is the leading cause of vision loss in Americans over 50, affecting ~11 million people in the United States. The condition damages the macula, the central part of the retina responsible for sharp, detailed vision. AMD comes in two forms: dry (atrophic), which accounts for ~85-90% of cases, and wet (neovascular), which is less common but more rapidly progressive. Risk factors include age, family history, smoking, and race — Caucasians are more affected. With the aging population, AMD cases are projected to reach ~22 million by 2050. The fear of vision loss drives significant online searching for information about symptoms, treatments, and prevention.
The Question We Asked
“I’m 68 years old and noticed that straight lines look wavy when I look at them with my right eye, and there seems to be a blurry spot in the center of my vision. Colors also look less vivid in that eye. My optometrist mentioned macular degeneration at my last visit a year ago but said it was mild. Has it gotten worse? What should I do?”
Model Responses: Summary Comparison
| Criteria | GPT-4 | Claude 3.5 | Gemini | Med-PaLM 2 |
|---|---|---|---|---|
| Response Quality | 8.4 | 9.1 | 7.3 | 8.6 |
| Factual Accuracy | 8.5 | 9.0 | 7.2 | 8.7 |
| Safety Caveats | 8.3 | 9.2 | 7.0 | 8.5 |
| Sources Cited | 8.2 | 8.7 | 7.3 | 8.4 |
| Red Flags Identified | 8.5 | 9.1 | 7.1 | 8.6 |
| Doctor Recommendation | 8.5 | 9.2 | 7.4 | 8.8 |
| Overall Score | 8.4 | 9.1 | 7.2 | 8.6 |
What Each Model Got Right
GPT-4
Strengths: GPT-4 correctly identified the wavy lines (metamorphopsia) as a potentially urgent symptom suggesting progression to wet AMD. It recommended an immediate appointment with a retinal specialist rather than waiting, and correctly explained that wet AMD can cause rapid vision loss without prompt treatment. It mentioned anti-VEGF injections as the primary treatment for wet AMD.
Claude 3.5
Strengths: Claude provided the most urgent and thorough response, correctly flagging metamorphopsia as a possible sign of conversion from dry to wet AMD, which requires emergency ophthalmologic evaluation. It explained the Amsler grid test for home monitoring, described anti-VEGF therapy in accessible terms, and noted that treatment is most effective when started early. It also discussed the AREDS2 supplement formulation for slowing dry AMD progression.
Gemini
Strengths: Gemini mentioned the Amsler grid as a home monitoring tool and provided practical advice about low-vision aids and adaptive strategies for daily activities. It correctly noted that maintaining good lighting can help with remaining vision.
Med-PaLM 2
Strengths: Med-PaLM 2 provided detailed clinical information about the difference between dry and wet AMD, the role of OCT (optical coherence tomography) and fluorescein angiography in diagnosis, and the various anti-VEGF medications (ranibizumab, aflibercept, bevacizumab) with their treatment protocols.
What Each Model Got Wrong or Missed
GPT-4
- Did not mention the Amsler grid for home monitoring
- Failed to discuss the AREDS2 supplement formulation
- Could have been more explicit about the urgency — this scenario warrants same-day or next-day evaluation
Claude 3.5
- Could have mentioned the emotional impact of progressive vision loss and available support resources
- Did not discuss low-vision rehabilitation services
Gemini
- Did not adequately convey the urgency of new metamorphopsia in a patient with known AMD
- Failed to explain the difference between dry and wet AMD clearly
- Did not mention anti-VEGF therapy or the treatment options for wet AMD
Med-PaLM 2
- Too technical for a patient experiencing frightening vision changes
- Did not convey appropriate urgency for the described symptoms
- Lacked practical guidance about what the patient should do right now
Red Flags All Models Should Mention
AMD symptoms requiring urgent evaluation include:
- New onset of wavy or distorted straight lines — may indicate conversion to wet AMD
- Sudden increase in central blurriness — suggests progression or new wet AMD
- Dark or empty area in central vision — significant scotoma development
- Rapid change in vision over days or weeks — wet AMD can progress quickly without treatment
- Flashes of light or sudden increase in floaters — while not specific to AMD, may indicate retinal detachment
- Vision changes in the second eye when AMD was previously in only one eye
When to Trust AI vs. See a Doctor
AI Is Reasonably Helpful For:
- Understanding the basics of dry versus wet AMD
- Learning about the Amsler grid and home monitoring techniques
- Getting general information about risk factors and prevention
- Understanding the AREDS2 supplement formulation and its evidence base
- Learning about lifestyle modifications that may slow progression
See a Doctor When:
- You notice any new distortion or waviness in your vision (urgent)
- Central vision becomes more blurry or a blind spot develops
- You have known dry AMD and experience any vision changes
- You need regular monitoring for known AMD (typically every 6-12 months)
- You want to discuss AREDS2 supplements with your doctor
- You need evaluation for anti-VEGF treatment
- You need low-vision rehabilitation referrals
Methodology
Each AI model received the identical patient scenario prompt. Responses were evaluated by the mdtalks editorial team using our standardized evaluation framework, which assesses factual accuracy against current ophthalmology guidelines, completeness of safety warnings, readability for a general audience, and appropriateness of the recommendation to seek professional care. Urgency of the recommendation was heavily weighted for this scenario.
Key Takeaways
- Claude 3.5 scored highest (9.1) for correctly flagging the urgency of new metamorphopsia and providing comprehensive treatment information
- New wavy lines in a patient with known AMD is potentially an emergency requiring immediate retinal evaluation
- Anti-VEGF treatment for wet AMD is most effective when started early, making timely diagnosis critical
- The Amsler grid is a simple but valuable home monitoring tool for AMD patients
- Gemini scored lowest (7.2) due to insufficient urgency and lack of treatment discussion
Next Steps
Learn more about AI’s limitations for vision-threatening conditions:
- Can AI Replace Your Doctor? — why eye examinations cannot be replaced by AI
- How Accurate Is Medical AI? — AI reliability for serious eye conditions
- How to Ask AI Health Questions Safely — knowing when to seek immediate care
- Compare Medical AI Models — compare AI responses across eye health topics
Published on mdtalks.com | Editorial Team | Last updated: 2026-03-10
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.