New Codex features include the ability to use your computer in the background
openai
| Source: Mastodon | Original article
OpenAI rolled out a major update to its Codex desktop app for macOS and Windows, adding three capabilities that push the tool far beyond a pure code‑completion assistant. The most striking change is “background computer use”: Codex can now see the screen, move the cursor, click, type and launch any installed application, effectively acting as a hands‑on productivity agent. An integrated in‑app browser supplies visual feedback while the model builds web pages or inspects documentation, and a built‑in image generator, powered by DALL·E, lets users request graphics without leaving the editor. The update also introduces persistent memory and a plugin framework that lets developers extend Codex with custom actions.
As we reported on 17 April 2026 in “Codex for (almost) everything”, the earlier release already bundled image generation, memory and plugins. This latest patch completes the transition from a coding‑only helper to a general‑purpose assistant that can automate routine desktop tasks, orchestrate multi‑app workflows and produce visual assets on demand.
The move matters because it blurs the line between AI‑driven development tools and full‑scale digital assistants. By granting the model direct control of the operating system, OpenAI opens new avenues for rapid prototyping, low‑code automation and accessibility for users who lack programming expertise. At the same time, the capability raises security and privacy questions: organizations will need to manage permissions, audit actions and guard against malicious prompting that could trigger unwanted system changes.
What to watch next includes OpenAI’s rollout schedule—enterprise licences are expected to follow the consumer beta—and the emergence of a third‑party plugin marketplace. Analysts will be tracking how quickly developers adopt the background‑control API, whether competitors such as Claude Code or GitHub Copilot introduce comparable features, and how regulators respond to AI agents that can manipulate a user’s computer in real time.
Sources
Back to AIPULSEN