Broadcom and OpenAI Introduce 'Jalapeño' AI Inference Chip
chips inference openai
| Source: Benzinga on MSN | Original article
Broadcom and OpenAI unveil Jalapeño, a custom AI inference chip.
Broadcom and OpenAI have unveiled Jalapeño, a custom AI inference chip designed specifically for large language model inference. This development is significant as it marks OpenAI's first custom Intelligence Processor, built to improve performance, efficiency, and scale across AI systems.
As we reported on June 24, OpenAI and Broadcom's collaboration on this project aims to create a multi-generation compute platform. The introduction of Jalapeño puts pressure on existing market players, particularly Nvidia, with its substantially better performance-per-watt than current GPUs. The commitment to deploy 10 gigawatts of OpenAI's infrastructure using this technology underscores the companies' ambitious plans.
What to watch next is how Jalapeño will be integrated into OpenAI's systems and the impact it will have on the AI industry. With a custom chip designed from scratch in just nine months, the future of LLM inference may see significant advancements, potentially changing how we use AI. As the first in a series of collaborations, the development of Jalapeño is an important milestone, and its effects on the market will be closely monitored.
Sources
Back to AIPULSEN