Jan Stoica

Co-founder of Databricks, AnyScale, and Elamarena, and an expert on AI infrastructure and geopolitics.

Claims

As speaker

Mentioned in

Key positions and views

China is currently leading the world in the development of the best open-source large language models, surpassing the US in this domain.

The United States suffers from a 'structural disadvantage' in AI development due to siloed research at major labs and the exclusion of academia from foundational model creation, which stifles innovation.

NVIDIA's dominance in AI hardware is primarily defended by its robust software stack, a moat that competitors like Google, AWS, and AMD have found exceedingly difficult to overcome despite producing good hardware.

Current popular methods for evaluating LLMs, such as 'LLM as a judge' and crowdsourced leaderboards, are inherently flawed and suffer from biases like positional, verbosity, and self-preference.

The massive capital investment into AI data centers by hyperscalers is 'very likely' to lead to an overbuilding of infrastructure, echoing the boom-and-bust cycle of the dot-com era.

Podcast consensus on Stoica

Points of consensus

▶Stoica consistently argues that China possesses significant structural advantages in AI development, including long-term state funding for strategic initiatives and strong collaboration between industry and academia.Apr 2026

▶He repeatedly emphasizes that the US AI ecosystem is inefficiently siloed, with frontier labs duplicating work and academia largely excluded from foundational model development, which limits the diffusion of innovation.Apr 2026

▶He maintains that NVIDIA's primary competitive advantage is its mature software stack, which has proven difficult for competitors with high-quality hardware (like Google, AWS, and AMD) to replicate.Apr 2026

▶Across his commentary, Stoica asserts that the most significant recent progress in open-source large language models has originated from China, a development he found surprising.Apr 2026

Points of debate

▶Stoica expresses a tension between his prior expectations and current reality, noting he was surprised that China, not the US, has taken the lead in open-source model development over the past year.Apr 2026

▶He highlights a potential market contradiction by observing the massive, ongoing build-out of AI data center infrastructure while also predicting it is 'very likely' to result in an overbuild situation reminiscent of the dot-com bubble.Apr 2026

▶There is a conflict between his market expectation and observation regarding AI hardware; he thought more viable alternatives to NVIDIA would emerge over the last year but concedes this has not happened.

▶Stoica presents a complex picture of the US AI landscape, describing it as having a fundamental 'structural disadvantage' while simultaneously acknowledging it is home to the major frontier labs, suggesting a dynamic of simultaneous leadership and systemic weakness.

Key themes

▶China's Ascendancy in the AI RaceApr 2026

Stoica argues that China is not merely a competitor but is actively leading in key areas of AI, particularly in the development of the best open-source large language models. He attributes this to structural advantages like sustained state funding for strategic goals and deep, effective collaboration between its tech industry and academic institutions.

This perspective challenges the Western-centric view of AI innovation, suggesting that investors and analysts should re-evaluate geopolitical risk and recognize China's coordinated national strategy as a primary driver of long-term competitive advantage in the sector.

▶The US's Structural Disadvantage in AIApr 2026

Stoica posits that the US AI ecosystem is fundamentally hampered by its siloed nature, where frontier labs duplicate efforts and academia is marginalized from pre-training foundational models due to a lack of compute resources. He warns this structure creates a 'limited diffusion of innovation' compared to China's more integrated approach.

This analysis implies that private-sector dominance alone may be insufficient for long-term US leadership; policy and investment may need to shift towards fostering a more open, collaborative ecosystem that reintegrates academia to maintain a competitive edge.

▶NVIDIA's Enduring Software MoatApr 2026

While acknowledging the high quality of competing hardware from Google (TPUs), AWS (Trainium), and AMD, Stoica identifies NVIDIA's software stack as its true, defensible moat. He notes that viable alternatives have failed to emerge as quickly as he expected, underscoring the immense difficulty and importance of the software ecosystem in the AI hardware market.

For analysts, this reinforces that the AI chip war is not just about performance benchmarks but about the entire developer ecosystem, making NVIDIA's market position far more resilient than a pure hardware comparison would suggest.

▶The Fragility of LLM EvaluationApr 2026

Stoica critiques the current state of LLM evaluation, citing UC Berkeley research on the 'LLM as a judge' technique pioneered with GPT-4. He highlights that these evaluation methods are subject to significant, measurable flaws, including positional bias, verbosity bias, and self-preference bias, making leaderboards an imperfect measure of model quality.

Stoica's skepticism towards existing benchmarks signals a significant market opportunity for more robust, objective, and unbiased evaluation platforms, which is the problem his new company, Elamarena, aims to solve.

Source episodes

Timeline

Over one year ago

Stoica held expectations that the US would lead in open-source model progress and that more viable hardware alternatives to NVIDIA would emerge.

Past year

Stoica observed a reality that contradicted his expectations, noting he was 'pleasantly surprised' by the significant progress in open-source models coming from China and disappointed by the lack of new, viable competitors to NVIDIA's hardware dominance.

Present

Stoica assesses that the US has a 'structural disadvantage' in AI due to its siloed research ecosystem and has lost its leadership position to China in multiple high-tech industries. He also observes a massive build-out of AI data center infrastructure by hyperscalers.

Next few years

Stoica predicts that China will successfully build out its own domestic AI compute infrastructure to overcome US export controls and that the current infrastructure boom will likely result in an 'overbuilding' scenario similar to the dot-com bubble.

Suggested prompts

How does Jan Stoica's assessment of China's 'structural advantage' in AI challenge prevailing Silicon Valley narratives about innovation? &nearr;If Stoica's prediction of an AI infrastructure 'overbuild' is correct, what are the likely consequences for hyperscalers, GPU manufacturers, and AI startups? &nearr;What specific policy or industry changes would be necessary to address the 'structural disadvantage' Stoica identifies in the US AI ecosystem? &nearr;Based on Stoica's critique of LLM evaluation biases, what new methodologies or business models could emerge to provide more reliable model assessment? &nearr;

Key concepts

China AI Strategy 1 ep Open Source LLMs 1 ep US AI Ecosystem 1 ep NVIDIA 1 ep AI Hardware Competition 1 ep LLM Evaluation 1 ep AI Infrastructure Investment 1 ep Academia in AI 1 ep Databricks 1 ep

Notable quotes

“But definitely at this point, if you're talking about your open source models, the best car coming from China.”

Jan Stoica · Databricks Co-Founder: Eval Limitations, Why China is Winning Open Source and Future of AI Infra

“And unless that changes, we are going to be a structural disadvantage because the diffusion of innovation is very limited.”

Jan Stoica · Databricks Co-Founder: Eval Limitations, Why China is Winning Open Source and Future of AI Infra

“I think overbuilding, it's very likely that it will happen, like with the internet. That's what happened with the internet.”

Jan Stoica · Databricks Co-Founder: Eval Limitations, Why China is Winning Open Source and Future of AI Infra

“The other thing, I was pleasantly surprised by the progress of the open source. Now, this came from where I, maybe more than one year ago, I haven't expected, came more from China rather than the US.”

Jan Stoica · Databricks Co-Founder: Eval Limitations, Why China is Winning Open Source and Future of AI Infra

Report last updated: Apr 21, 2026

Get started free

Back to Entities Intelligence Report