June 11, 2026
What are experts saying about how long the AI compute build-out can run — where demand for chips, networking, and data-center hardware is headed, and which layers face the most oversupply risk?
The AI compute build-out is widely viewed as a sustained, multi-year cycle, with some experts predicting the underlying supply-demand imbalance for key hardware will persist for a decade or more [4, 7, 13]. Data center capacity is already planned through 2027-2028, making a near-term slowdown unlikely , and some forecasts suggest supply will lag demand for at least the next three to five years [26, 30]. A central consensus among analysts is that the primary bottleneck has decisively shifted away from the availability of GPUs themselves [8, 12]. The new constraints are now in the foundational physical infrastructure required to operate the chips, specifically the availability of **"powered shells"**—data centers with sufficient energy, cooling, and real estate [1, 9, 23]. This infrastructure layer faces its own severe shortages in components like transformers, switchgears, and structural steel, as well as in skilled labor such as electricians, which are now gating the pace of expansion [2, 9, 16]. Energy supply, in particular, is identified as the main bottleneck for the next five years , with one expert predicting the energy shortage may begin to alleviate around 2027 or 2028 .
Demand for this infrastructure is not only unrelenting but also evolving in nature, fueling the long-term outlook . A significant driver is the enterprise shift from cloud-based testing to on-premise production deployments, motivated by needs for data security and control [4, 7, 19]. Concurrently, workloads are transitioning from a primary focus on centralized model training to the more complex and distributed problem of inference , though training still constitutes most of the current demand . Looking forward, experts point to the emergence of "Agentic AI," where AI systems execute tasks rather than just generate content, as a paradigm that will fuel a massive new demand cycle for GPUs, high-performance CPUs, and vast amounts of memory [4, 7, 19]. This sustained demand reinforces the market position of dominant players like NVIDIA, whose hardware is exclusively requested by major customers due to the strength of its CUDA software ecosystem , a moat competitors have failed to overcome .
Go deeper
Search this topic across 400+ expert conversations on Sonic.
Despite the strong demand outlook, there is a notable tension regarding the risk of oversupply, particularly in data center capacity. Several analysts warn that the massive capital expenditures by hyperscalers could lead to an overbuild, drawing parallels to the fiber-optic glut of the dot-com bubble [14, 18, 22]. Investors are beginning to question whether projected demand will materialize by the time new facilities become operational . This could create a scenario where there is a surplus of chips that cannot be powered due to energy and infrastructure bottlenecks . However, this view is contested. NVIDIA's CEO sees a near-zero probability of a compute glut in the next two to three years, as the largest cloud providers are absorbing the initial build-out for their core businesses . Furthermore, the useful life of GPUs may be significantly longer than commonly assumed, potentially **6-8 years** or more, as a diverse ecosystem of models will create value for older hardware on less demanding tasks . This extended depreciation horizon changes the risk profile for financing hardware, suggesting that while a glut of physical data center space is a risk, the underlying demand for a matrix of computing capabilities is more durable.
What the sources say
Points of agreement
- •The primary bottleneck for AI expansion has shifted from a shortage of chips to a shortage of physical infrastructure like powered data centers, energy, and cooling.
- •The AI compute build-out is a long-term cycle, with experts forecasting that demand will outstrip supply for the next three to ten years.
- •Demand for AI hardware is described as 'unrelenting' and 'insatiable,' particularly for key components like high-bandwidth memory and advanced semiconductors.
- •NVIDIA's dominance in high-performance compute remains strong, largely due to the strength of its CUDA software and developer ecosystem.
Points of disagreement
- •Experts disagree on the risk of oversupply, with some predicting a 'very likely' overbuild similar to the dot-com bubble, while others see a 'near-zero probability' of a glut in the next few years.
- •While most agree GPUs are central, some argue their useful life could be 6-8 years, while others suggest advanced AI models are already evolving 'past the sweet spot' of current GPU architecture.
- •The primary driver of current compute demand is debated, with some sources stating it is for training models, while others highlight a significant shift towards inference and emerging 'agentic AI' workloads.
Sources
How CoreWeave Sees the Market for Compute Right Now | Odd Lots
This episode argues the primary AI bottleneck has shifted from GPUs to 'powered shells' (data centers) and that GPUs have a long, 6-8 year useful life, making them a stable asset class for financing.
Who's Actually Funding the AI Buildout? (No Priors)
This source explains that the AI buildout requires trillions in capital and that the key constraint is shifting from chip availability to foundational infrastructure like power, transformers, and switchgears.
Nvidia’s CEO Says China Will Open Its Market to AI Chips From US (Bloomberg Technology)
This source describes a decade-long infrastructure buildout driven by 'Agentic AI,' where demand for memory and advanced semiconductors is expected to vastly outstrip supply.
Databricks Co-Founder: Eval Limitations, Why China is Winning Open Source and Future of AI Infra (Unsupervised Learning)
The Databricks co-founder warns of a 'very likely' overbuild in AI data center capacity, drawing parallels to the dot-com bubble, while also noting NVIDIA's continued market dominance.
The Biggest Bottlenecks For AI: Energy & Cooling (a16z Podcast)
This podcast identifies energy supply as the primary bottleneck for AI growth over the next five years, with cooling technology presenting the subsequent challenge.
Nvidia CEO Jensen Huang & Dell CEO Michael Dell on Agentic AI, Memory Demand and China |... (Bloomberg Audio Studios)
The CEOs of Nvidia and Dell discuss the shift to on-premise enterprise AI and the rise of 'agentic AI,' which they predict will fuel a decade-long infrastructure buildout constrained by memory and semiconductor supply.
Related questions
Given the shift to physical infrastructure bottlenecks, which specific sub-sectors like power generation, grid technology, or cooling systems present the most critical investment opportunities?
→How will the hardware mix (GPUs, CPUs, memory, networking) need to change as workloads shift from training to inference and agentic AI, and what is the expected timeline for this transition?
→What are the key financial risks if a compute oversupply occurs, and how are companies using financing structures like SPVs to mitigate the multi-trillion dollar capital expenditures required?
→Ask your own research questions
Search and synthesize across 400+ expert conversations in real time.
Try: “What are experts saying about how long the AI compute build-out can run — where demand for chips, networking, and data-center hardware is headed, and which layers face the most oversupply risk?”
Search this on Sonic →