OpenAI VP talks Jalapeño inference chip co‑designed with Broadcom using internal OpenAI models
chips inference openai
| Source: Techmeme | Original article
OpenAI’s VP of Hardware Richard Ho detailed the Jalapeño inference chip, co‑designed with Broadcom and created using OpenAI’s internal models, confirming industry expectations in June 2026.
OpenAI’s hardware chief, Richard Ho, sat down with Dr. Ian Cutress for a detailed Q&A that sheds light on the company’s first custom inference processor, the Jalapeño chip. Co‑designed with Broadcom, Jalapeño is the result of a year‑long industry expectation that OpenAI would move beyond off‑the‑shelf accelerators. Ho confirmed that the chip was built using OpenAI’s own internal models, a design approach the company says “established a new baseline” for AI‑driven hardware development.
Early performance data, shared in the interview, indicate that Jalapeño already delivers noticeable latency reductions for ChatGPT responses and makes Codex‑driven coding sessions and autonomous agents more responsive. Ho described the results as “chart‑topping,” and noted that the chip’s integration with OpenAI’s inference stack is already delivering tangible user‑experience gains.
The announcement matters because it marks a shift from reliance on third‑party GPUs to purpose‑built silicon that can be tightly coupled with OpenAI’s software stack. By leveraging its own models for chip design, OpenAI demonstrates a closed‑loop workflow that could accelerate innovation cycles and reduce dependence on external foundries. Industry observers have taken note; Ho mentioned that “the industry is already knocking on OpenAI’s door” to learn how the chip was pulled off, hinting at possible spill‑over effects for other AI firms.
What to watch next includes the broader rollout of Jalapeño across OpenAI’s data centres, especially its pairing with AMD EPYC Turin servers—a deployment we first reported on [2026‑10‑04]. Follow‑up signals may reveal scaling timelines, pricing strategies, and whether OpenAI will license the design or keep it exclusive. The next few quarters will show whether Jalapeño can reshape the competitive landscape of AI inference hardware.
Sources
Back to AIPULSEN