OpenAI Codex Can Now Control Your Mac Apps to Write Code For You. No API Needed.
agents openai
| Source: Dev.to | Original article
OpenAI has rolled out a major upgrade to its Codex app for macOS, turning the tool into a screen‑aware AI agent that can see, click and type across any desktop application without the need for an external API. The new “always‑on” mode runs in the background, watches the user’s workflow, and can launch or manipulate apps, fill forms, browse the web and even generate images, all while keeping a memory of past actions. For developers, the update adds native support for reviewing pull requests, opening multiple files and terminals, and connecting to remote devboxes via SSH, effectively turning the Mac into a hands‑free coding workstation.
The move is significant because it lowers the barrier to building AI‑driven automation. Previously, developers had to stitch together custom scripts or rely on limited integrations; now Codex can interact with any GUI‑based tool, from design software to database consoles, using visual cues rather than predefined endpoints. This expands the practical reach of large language models from code suggestion to end‑to‑end task execution, a capability that directly challenges Anthropic’s Claude Code, which has been marketed as a comparable “AI‑as‑a‑developer” assistant. As we reported on 17 April 2026, Uber’s runaway AI budget highlighted the cost risks of such agents; OpenAI’s on‑device approach could mitigate cloud‑compute expenses while raising fresh concerns about privacy and inadvertent automation errors.
What to watch next: OpenAI will likely open the multi‑agent framework to third‑party extensions, enabling developers to script bespoke agents for niche workflows. Security researchers are expected to probe the new screen‑control permissions for potential abuse vectors. Finally, the industry will be watching whether enterprise customers adopt Codex as a low‑code alternative to internal RPA solutions, and how competitors respond with tighter sandboxing or richer API ecosystems.
Sources
Back to AIPULSEN