Doctor compelled to apologise after AI makes alarming mistake about illegal drugs
| Source: Mastodon | Original article
A doctor apologized after an AI transcription error mistakenly linked a patient’s urology visit to illegal drug use, raising concerns over AI use in medical records.
A urologist in the United Kingdom has been forced to apologise after an artificial‑intelligence transcription tool mistakenly recorded that a patient was using an illegal drug. Rebecca Green, who consented to have her first urology appointment transcribed by AI, later complained that the generated note incorrectly flagged her as a drug user. The error prompted the doctor to send a formal letter of apology to Green, acknowledging the mistake and the distress it caused.
The incident highlights the growing tension between the efficiency promised by generative‑AI assistants and the risks they pose in clinical settings. Health practitioners are increasingly deploying AI to capture and summarise patient information, but the technology can still produce inaccurate or misleading statements. When such errors touch on sensitive topics—especially illegal substance use—they can damage patient trust and expose clinicians to legal scrutiny.
The case arrives amid a broader debate over who should bear responsibility for AI‑driven medical errors. Earlier this year, Sermo contributors argued that, despite AI’s advisory role, liability remains with the physician, not the software developer. The Medical Protection Society has called for legislative reform to shield clinicians from lawsuits arising from AI mistakes, while legal scholars note that cases like Raine v. OpenAI may soon clarify developers’ obligations.
What to watch next: regulators in the UK and EU are expected to tighten guidance on AI use in patient records, and professional bodies may issue new consent protocols. Courts are also likely to hear more disputes over AI‑generated medical documentation, which could set precedents for liability and data‑handling standards across the NHS and private practices. The Green episode may become a reference point in those discussions, underscoring the need for robust oversight before AI becomes routine in clinical note‑taking.
Sources
Back to AIPULSEN