People horrified after reading Copilot prompts
copilot microsoft
| Source: Mastodon | Original article
Human contractors reviewing Microsoft’s Copilot AI prompts are repeatedly exposed to lewd and sexually explicit photo‑editing requests, including upskirt images and sexual positioning of women.
Microsoft’s Copilot AI chatbot is being fine‑tuned by a workforce of human contractors who, as recent reports reveal, are regularly exposed to users’ sexually explicit image‑editing requests. The reviewers see the full prompt, the uploaded photograph and the AI‑generated edit, and must decide whether the content complies with Microsoft’s policies. Among the material they encounter are upskirt photos and instructions to place women in sexual positions, prompting many contractors to describe the work as “horrifying.”
The practice raises two intertwined concerns. First, it spotlights a privacy gap: users upload personal images to a consumer‑facing tool, yet those files are later examined by third‑party staff. While Microsoft frames the human review as a quality‑control step to improve the model’s performance, the exposure of intimate content to contractors has sparked criticism from privacy advocates and heightened scrutiny of Microsoft’s data‑handling procedures. Second, the episode underscores the broader ethical challenge of scaling AI moderation. As large language and image models become more capable, companies increasingly rely on human labor to filter harmful outputs, a model that can place workers in distressing situations and potentially conflict with labor standards.
What to watch next is how Microsoft responds to the backlash. The company may revise its review workflow, introduce stricter anonymisation of user uploads, or limit the types of prompts that trigger human inspection. Regulators in the EU and the United States are also monitoring AI‑related privacy practices, so legislative pressure could prompt new compliance requirements. Finally, the story adds fresh urgency to the industry‑wide debate on whether human‑in‑the‑loop moderation can ever be reconciled with user privacy and worker wellbeing.
Sources
Back to AIPULSEN