Frontier Multimodal LLMs Excel in Ophthalmic Cases
benchmarks cohere multimodal
| Source: Journal of the American Medical Association | Original article
A cross‑sectional study evaluated three frontier multimodal large language models, measuring their accuracy in answering ophthalmic case queries.
A cross‑sectional study released this week evaluated how three frontier multimodal large language models (MLLMs) handle ophthalmic queries that combine text and optical coherence tomography (OCT) images. Researchers measured the models’ accuracy on both image‑based and purely textual questions, probing open‑ended clinical reasoning, multimodal information integration and natural‑language understanding.
The work builds on a growing body of research that questions the reliability of contemporary MLLMs in retinal imaging. Earlier investigations have compared six multimodal models on multiple‑choice retinal questions, highlighting gaps in performance that could limit clinical use. By focusing on real‑world ophthalmic cases rather than synthetic test sets, the new study offers a more realistic gauge of how these systems might assist eye‑care professionals.
The findings matter because ophthalmology increasingly relies on high‑resolution imaging to diagnose conditions such as macular degeneration and diabetic retinopathy. If MLLMs can accurately interpret OCT scans and translate that insight into actionable clinical answers, they could accelerate triage, support remote consultations and reduce specialist workload. Conversely, any shortfall underscores the risk of over‑reliance on AI in a field where diagnostic precision is critical.
Looking ahead, the authors point to the LMOD+ benchmark—a large‑scale, multimodal ophthalmology dataset covering over 30,000 instances across twelve common conditions—as the next testing ground for emerging models. Further validation on such datasets, coupled with regulatory scrutiny and integration trials in eye clinics, will determine whether MLLMs move from experimental comparison to practical deployment. The study adds a timely data point to the broader conversation about medical AI, echoing recent reports on AI systems that claim to outperform doctors in complex cases.
Sources
Back to AIPULSEN