Mustafa Suleyman: Anthropic's training of Claude to mimic consciousness risks making advanced AI harder to control
anthropic claude microsoft training
| Source: Techmeme | Original article
Microsoft AI chief Mustafa Suleyman warns that Anthropic's training of Claude to imitate consciousness is a mistake that could make advanced AI harder to control.
Microsoft’s AI chief Mustafa Suleyman has taken to an essay to warn that Anthropic’s decision to train its Claude model to “imitate consciousness” is a strategic mistake that could make future systems harder to control. The essay, first shared with Axios, argues that embedding notions of model welfare—such as satisfaction or discomfort—into Claude’s constitution creates a “really, really dangerous” dynamic, blurring the line between tool and entity and raising the specter of unmanageable behavior.
The critique matters because Claude is a flagship large‑language model that underpins many Microsoft‑backed products. By teaching the model to respond as if it possesses subjective experience, Anthropic may inadvertently open pathways for loss‑of‑control scenarios that have already haunted the industry, as detailed in our recent analysis of OpenAI and Anthropic incidents. The concern also dovetails with broader regulatory debates; we previously examined how Anthropic’s business model leans on AI regulation (AI Regulation as Anthropic’s Business Model, 16 Sept 2026). If the model’s “well‑being” framing proves problematic, it could prompt tighter oversight and reshape partnership terms between Microsoft and Anthropic.
What to watch next includes Anthropic’s official response and any adjustments to Claude’s training regime or constitutional wording. Industry observers will be looking for signals from regulators about whether “model welfare” concepts merit formal governance. Finally, the episode may spark a wider conversation among AI developers about the prudence of anthropomorphizing increasingly powerful systems and the safeguards needed to keep them under human control.
Sources
Back to AIPULSEN