New Study Reveals Half of AI-Generated Health Advice is Inaccurate Despite Sounding Plausible
deepseek gemini grok meta
| Source: Mastodon | Original article
A new study reveals nearly half of AI health responses are incorrect, despite sounding convincing. AI models fail to provide accurate medical answers.
A recent study has found that half of the health-related answers provided by popular AI chatbots, including ChatGPT, Gemini, and Grok, are incorrect, despite sounding convincing. The study, which posed 50 health and medical questions to these AI models, had two experts rate every answer, revealing a disturbing lack of accuracy.
This finding matters because people are increasingly relying on AI-powered chatbots for health information, which can have serious consequences if the advice is flawed. As we reported on June 8, companies like Anthropic are already seeing significant profits from their AI ventures, highlighting the rapid growth of the industry. However, this study suggests that the technology is not yet ready to provide reliable health advice.
As the use of AI in healthcare continues to expand, it is crucial to monitor the development of these models and ensure they are thoroughly tested for accuracy. The study's findings should serve as a warning to both developers and users of AI chatbots, emphasizing the need for human oversight and expertise in sensitive areas like healthcare.
Sources
Back to AIPULSEN