Token Prices Plummet, But Will This Alleviate or Exacerbate the AI Chip Shortage?
chips inference
| Source: Mastodon | Original article
AI token prices drop, but memory costs surge. Enterprise AI spending triples despite falling inference costs.
The cost of AI tokens has decreased significantly, with a 280-fold drop in inference costs over the past two years. However, this reduction in token prices has not led to a decrease in overall AI spending. Instead, enterprise AI spending has tripled, and the demand for memory and computing power has increased, driving up prices for components like DRAM. This phenomenon is reminiscent of the Jevons paradox, where increased efficiency leads to increased consumption.
This trend matters because it suggests that the AI chip shortage may not be alleviated by cheaper tokens alone. As companies spend more on AI, the demand for computing power and memory continues to rise, putting pressure on the supply chain. The record 90-95% quarterly jump in DRAM contract prices is a clear indication of this trend.
As the AI industry continues to evolve, it will be important to watch how companies balance the need for efficient token usage with the increasing demand for computing power and memory. Will the development of new AI chips, like those aimed at by DeepSeek, help to rebalance the market, or will the demand for components like DRAM and GPUs continue to outstrip supply? The answer to this question will have significant implications for the future of the AI industry.
Sources
Back to AIPULSEN