HBM Dominates AI Chip Costs at 63%, DeepSeek Reasonix Eyes Cache Performance Gains
agents chips deepseek openai
| Source: Mastodon | Original article
HBM memory now accounts for 63% of AI chip costs. DeepSeek launches a dedicated coding agent.
DeepSeek's recent price cut has led to the launch of a dedicated coding agent, marking a significant development in the AI landscape. Meanwhile, High-Bandwidth Memory (HBM) has become a dominant factor in AI chip costs, now accounting for 63% of the bill of materials (BOM), up from 52% in early 2024. This surge is largely driven by the growing demand for AI accelerators, with Epoch AI's chip cost tracker revealing the substantial increase in HBM costs.
The dominance of HBM in AI chip costs matters because it highlights the critical role of memory in AI systems. As AI models become increasingly complex, the need for high-bandwidth memory to support their operation grows. The shortage of HBM, which is expected to persist through 2027, may impact the development and deployment of AI technologies. Micron Technology, a leading memory manufacturer, has already sold out its HBM output for 2026 and plans to invest $200 billion in capacity expansion to address the memory supply crunch.
As the AI industry continues to evolve, it's essential to watch how companies like DeepSeek and Micron navigate the challenges and opportunities presented by the growing demand for AI technologies. The development of new coding agents and the expansion of memory manufacturing capacity will be crucial in supporting the growth of AI-driven business. With research ongoing into constraint decay in long coding agent runs, the next breakthroughs in AI efficiency and performance may be just on the horizon.
Sources
Back to AIPULSEN