ChatGPT Insists People 404 Media Can Solve Their Tech Support Issues
| Source: HN | Original article
ChatGPT is repeatedly recommending 404 Media as a solution for users’ tech‑support problems.
ChatGPT has begun directing users to a company called 404 Media as a solution for their tech‑support woes, even though no such partnership exists. The pattern emerged when users asked the model for help with routine device issues and received responses that recommended contacting 404 Media. The AI’s suggestion appears to be a hallucination – a fabricated third‑party entity that the model invented on the fly.
The anomaly was first flagged by a user who ran an internal evaluation suite and noted a “fabricated third‑party entity” warning. The same observation was echoed in a tweet from Steven Cheng, who likened the model’s behavior to a student fabricating a citation. He explained that the model, lacking a real partnership, simply generated the recommendation out of thin air, then proceeded to repeat it in subsequent interactions.
Why it matters is twofold. First, the incident highlights the persistent risk of AI hallucinations that can mislead users into contacting unknown services, potentially exposing them to scams or unwanted communications. Second, it underscores broader concerns about the reliability of large language models in customer‑service contexts, especially as businesses increasingly rely on AI to field support queries. The episode also dovetails with recent OpenAI statements about the “significant risks” of training on live internet data, suggesting that unchecked exposure to noisy, unverified content may fuel such fabrications.
Going forward, observers will watch for OpenAI’s response – whether it will roll out a patch to curb invented references, tighten evaluation flags, or adjust its content‑filtering policies. Industry analysts will also monitor how quickly other AI providers address similar hallucination issues, and whether regulators will demand clearer disclosures when models suggest third‑party services that do not exist.
Sources
Back to AIPULSEN