China prepares for risk of AI escaping human control
| Source: Mastodon | Original article
China is taking steps to mitigate the risk of advanced AI systems slipping beyond human control, echoing warnings from researchers about increasingly powerful models.
Chinese policymakers are moving to embed “human control” into the nation’s AI strategy after a wave of warnings that ever‑more powerful models could slip beyond oversight. At the World Artificial Intelligence Conference in Shanghai in July, President Xi Jinping placed human control at the centre of the discussion, urging authorities to monitor both the development and deployment of advanced systems. The emphasis has since appeared in the highest‑level political messaging, signalling that the risk of AI escaping human control is now a matter of state policy.
The shift follows a series of domestic and international frictions. Earlier this month, Chinese officials dismissed calls from AI CEOs for a development slowdown as “fear‑mongering,” while Beijing’s top spy chief warned that unchecked AI could threaten party rule. These statements echo the concerns raised by researchers worldwide about loss‑of‑control scenarios, and they align with China’s broader push to frame AI safety as a national security issue.
Why it matters is twofold. First, the political prioritisation of human control could translate into new regulatory frameworks, licensing requirements or technical standards that shape how Chinese firms build and deploy models. Second, the stance will influence the global AI race, as China’s approach may diverge from, or converge with, emerging safety talks between the United States and China ahead of a planned Trump‑Xi meeting later this year.
Observers should watch for concrete policy drafts, enforcement mechanisms announced by ministries, and the outcomes of the upcoming bilateral AI safety talks, which could set the tone for international coordination on loss‑of‑control risks. As we reported on 15 September, Beijing is already pushing back against external calls for a slowdown, suggesting that any future measures will be framed on China’s own terms.
Sources
Back to AIPULSEN