Skip to content

May 23, 2026

Enterprise AI

18 episodes16 podcastsSep 10, 2024 – May 18, 2026
SharePostShare

Despite a significant shift from proofs-of-concept to production deployments in critical sectors like banking and healthcare [17, 21], enterprise AI adoption faces a stark reality of high failure rates. As of October 2025, the cancellation rate for enterprise AI initiatives **exceeded 40%**, a 2.5-fold increase from the previous year, with some data suggesting 95% of clients see no tangible P&L impact [1, 2, 5, 9]. This chasm between technological promise and business value is not seen as a failure of the models themselves, but of implementation strategy and organizational change . While some frame the high failure rate as a positive sign of widespread experimentation , the consensus is that success requires moving beyond scattered pilots to industrialize AI within high-value business domains, driven by top-down executive mandates targeting ROI in areas like customer service and supply chain management [6, 19, 24].

The core technical challenge in enterprise AI is not model hallucination but the retrieval of correct, up-to-date, and permission-aware information from complex and siloed corporate data landscapes [7, 16]. The quality of any generative output is fundamentally dependent on the quality of the retrieved context, a problem compounded by legacy systems and undocumented operational knowledge residing only with specific employees [18, 28]. In response, a hybrid architectural approach has emerged, exemplified by companies like Glean, which use proprietary small language models trained on customer data for superior semantic retrieval while leveraging large third-party models for reasoning and synthesis [3, 12]. This strategy underscores a key insight: the value of enterprise AI lies not in the generic model, but in its ability to be safely and accurately grounded in proprietary, real-time business context, with user permissions baked directly into the retrieval process [3, 13].

Go deeper

Search this topic across 400+ expert conversations on Sonic.

Search →

The next frontier is the shift toward proactive and "agentic" AI capable of performing complex, multi-step tasks and automating entire business processes [4, 14]. This evolution introduces a critical tension between agent autonomy and control, as current AI reliability limits necessitate a **human-in-the-loop approach** for any high-stakes action that modifies enterprise data [4, 10]. Consequently, robust governance and observability platforms—featuring tools like agent registries and sandboxes—are becoming critical prerequisites for enterprises to de-risk the deployment of AI agents in production environments . The ultimate vision is to augment knowledge workers with teams of AI assistants, moving from a reactive, query-driven model to a proactive one where AI anticipates user needs to drive significant productivity gains [3, 4].

From a strategic perspective, successful AI adoption requires CEO-led initiatives focused on redesigning core business processes from the ground up, rather than simply automating existing workflows . While the total addressable market was approximately **$37 billion in 2023** , skepticism persists regarding the ultimate business models and the unproven economic viability of agentic automation compared to content creation use cases [23, 25]. The future market structure is also debated; some predict an initial fragmentation of best-of-breed solutions will eventually consolidate towards a single, integrated platform , while others argue that enterprise AI markets will remain more fragmented than their winner-take-most consumer counterparts . To bridge the gap, strategic partnerships between technology providers and consultancies are seen as critical for combining platform capabilities with the domain expertise and change management needed to deliver value .

What the sources say

Points of agreement

  • Enterprises are struggling to translate AI potential into business value, leading to very high project cancellation and failure rates.
  • The focus of enterprise AI is shifting from isolated pilot projects to scaled, production deployments integrated into core business processes.
  • The primary challenge and value driver for enterprise AI is retrieving correct, up-to-date, and permission-aware information from complex internal systems.
  • For high-stakes tasks that modify enterprise data, a 'human-in-the-loop' approach is essential due to current AI reliability limits.

Points of disagreement

  • Experts disagree on the future market structure, with some predicting consolidation into a single platform and others expecting continued fragmentation.
  • While some see high project failure rates as a sign of a hype bubble and lack of ROI, others view it positively as a sign of widespread experimentation.
  • There are conflicting views on economic viability, with some highlighting high-ROI use cases while others state the business case for agentic automation is unproven and P&L impact is rare.

Sources

The Montgomery Summit 2026MAR 16, 2026

Building the Enterprise of the Future presented by QuantumBlack, AI by McKinsey

This source highlights the significant gap between AI's potential and business reality, citing high project cancellation rates and a lack of P&L impact for 95% of clients.

View →
Gradient DissentAUG 5, 2025

Arvind Jain on building Glean and the future of enterprise AI

Glean's CEO argues that the core challenge in enterprise AI is building robust retrieval systems that can access correct, permission-aware information, not the generative models themselves.

View →
Greylock Change AgentsJAN 20, 2026

The Enterprise Brain for AI Agents with Glean and Cresta

This discussion explores the evolution toward AI agents, emphasizing the necessity of a human-in-the-loop for high-stakes tasks and the threat of data access restrictions from incumbents.

View →
The Montgomery SummitMAR 16, 2026

How KPMG Is Building an AI-Powered Future

This source posits that successful AI adoption requires CEO-led initiatives and strategic partnerships to redesign core business processes, rather than deploying isolated point solutions.

View →
TwiML AI PodcastAPR 24, 2026

How to Adopt AI Agents in Your Enterprise with Google Cloud's Riyaz Habibbhai

This podcast explains that the move to agentic AI requires new platforms with robust governance and observability features to de-risk deployment in production environments.

View →
CXOTalkSEP 10, 2024

Enterprise AI Strategy and CEO Leadership, with McKinsey & Company | CXOTalk #851

This source emphasizes the strategic need for CEOs to move beyond isolated pilots and industrialize AI within high-value domains to achieve scale and significant business outcomes.

View →

Related questions

Ask your own research questions

Search and synthesize across 400+ expert conversations in real time.

Try: “Enterprise AI

Search this on Sonic →