VICTORIA. Book a call

Home / Journal / Pilot to Production

Pilot to Production

Why 95% of AI Pilots Never Reach Production

The 95% figure measures return, not survival. The production numbers are worse, and the causes are mostly decided before the build starts.

Why do AI pilots fail?

Your pilot worked in the demo. Six months later it is still a pilot. If you are asking why do AI pilots fail, the short answer is that most of them were never set up to pass. Nobody agreed the number they had to move, the pilot ran on exported data instead of the live system, and no one owned the result. The model is rarely the cause.

That is the conclusion. The rest of this article is the evidence behind it, a plain reading of the 95% figure everyone quotes, and a seven-question test you can run on your own pilot this week.

Is it true that 95% of AI pilots fail?

Not quite. The 95% figure comes from MIT Project NANDA's 2025 report, The GenAI Divide, and it measures return, not survival: 95% of organizations get zero return on their generative AI investment. A pilot can be live and still return nothing.

The production figure from the same report is the one that matters here. As reported by Virtualization Review in August 2025, 60% of organizations evaluated enterprise-grade AI systems, 20% reached the pilot stage and 5% reached production. The report draws on a review of more than 300 publicly disclosed AI initiatives, 52 structured interviews and 153 survey responses. So the honest headline is this: about one in twenty custom enterprise AI tools reaches production.

The drop is not between idea and pilot. It is between pilot and production.

What does the 2025 and 2026 data say about stalled pilots?

Every major survey points the same way: a minority of companies ship, and a smaller minority can point to earnings. The figures measure different things, so read them side by side rather than as one failure rate.

46%
of AI proofs of concept scrapped before production, on average
S&P Global Market Intelligence, 2025, n=1,000+
25%
have moved 40% or more of their AI pilots into production
Deloitte, State of AI in the Enterprise 2026, n=3,235
37%
attribute at least some EBIT impact to AI
McKinsey, The State of AI 2026, n=1,719
SourceWhat it measuresFinding
MIT Project NANDA, 2025Return on generative AI spend95% of organizations get zero return
S&P Global Market Intelligence, 2025Initiatives abandoned42% abandoned most AI initiatives, up from 17% the year before
Deloitte, 2026Pilots moved to production25% have moved 40% or more; 54% expect to within three to six months
McKinsey, 2026Earnings impact37% attribute at least some EBIT impact, essentially unchanged from 2025
Gartner, 2025Agentic AI forecastOver 40% of agentic AI projects canceled by the end of 2027

The S&P Global figures come from a survey of more than 1,000 respondents in North America and Europe, reported by CIO Dive in March 2025. Deloitte's 54% is an expectation, not a result. Treat it as one.

What are the most common reasons AI pilots fail?

Five causes recur across the research, and four of them are decided before anyone writes a prompt. Here is each one, with the evidence behind it.

1. Nobody defined what passing looks like

Gartner's June 2025 forecast names unclear business value as one of three reasons agentic AI projects will be canceled, alongside escalating costs and inadequate risk controls. A pilot with no number agreed in advance cannot pass. It can only be liked or not liked.

2. The systems were not ready for it

Grant Thornton's 2026 AI Impact Survey of 950 business leaders found 55% of CIOs and CTOs say fewer than half their core applications are AI-ready. The pilot ran on a clean export. Production has to run on the system of record, with its permissions, rate limits and stale fields.

3. The system does not learn

MIT's report locates the gap in how tools behave after launch: most generative AI systems do not retain feedback, adapt to context or improve over time. A tool that makes the same mistake in month three that it made in week one loses its users.

4. Leadership owned the idea, not the outcome

RAND's 2024 study, based on interviews with 65 experienced data scientists and engineers, lists leadership-driven failures first among its root causes, ahead of data, bottom-up projects, infrastructure and immature technology. If nobody's target moves when the workflow improves, nobody defends it.

5. There were no controls, so nobody would sign off

Grant Thornton found 78% of leaders lack strong confidence they could pass an independent AI governance audit within 90 days, and just 20% have a tested AI incident response plan. A risk committee asked to approve a system with no spend limit and no kill switch will say no, and should.

Is the AI model usually the problem?

Rarely. In RAND's list of root causes, immature technology comes last. The failures that come first are about who decided what, which data was available and what infrastructure existed.

This matters because the usual response to a stalled pilot is to try a newer model. That changes the one variable least likely to be wrong. If the pilot never had a pass mark, a better model will not give it one.

How can you tell if your AI pilot is going to fail?

Ask seven questions. Each "no" is a reason the pilot will stall, and two or more means it will not reach production in its current form.

  1. Can you name the one workflow in a sentence? One queue, one document type, one motion.
  2. Is there one owner whose target moves if it works? A person, not a committee.
  3. Was the success number written down before the build? Resolution rate, cycle time, cost per case or error rate, with a date against it.
  4. Does it run against the live system? Not a spreadsheet someone exported in week one.
  5. Has it been tested on 100 to 300 real cases? Including the malformed ones and the ones a person got wrong.
  6. Was the pass mark set before the test ran? Set it after and it will move.
  7. Are spend limits, retry limits and a kill switch in place? Plus a human in the loop where an error costs money.

If your pilot already shipped and fails these questions in production, that is a different problem. Our AI Rescue triage gives a written fix, rebuild or retire verdict in 48 hours.

What do AI pilots that reach production do differently?

They change the workflow, not just the tool, and they measure it. McKinsey's State of AI 2026 found nearly three-quarters of AI high performers report fundamentally redesigning workflows because of AI, against about one-quarter of other respondents. High performers are also twice as likely to have defined processes for measuring AI impact.

The payoff for getting through is real. Grant Thornton found organizations with fully integrated AI report revenue growth at 58%, against 15% for those still piloting. The usage is there. The earnings arrive only after production.

That is the method we use with mid-market companies: one workflow, one owner, one number, agreed up front. We build against your real systems, test on 100 to 300 of your real cases against a pass mark set in advance, and deploy with spend limits, retry limits, a kill switch and humans in the loop. The full sequence is in our pilot to production playbook.

Questions we get asked

Why do most AI pilots fail?
Most AI pilots fail because they were never set up to pass. There is no success number agreed in advance, the pilot runs on exported data rather than the live system, and no single person owns the result. RAND's 2024 study puts leadership-driven failures first among root causes and immature technology last. The model is rarely what stops a pilot reaching production.
Is the MIT 95% AI failure statistic accurate?
It is accurate for what it measures. MIT Project NANDA's 2025 report found 95% of organizations get zero return on generative AI investment. That is a return figure, not a production figure. The same report found 5% of organizations reached production with enterprise-grade systems, after 60% evaluated them and 20% piloted them. Quote the number for what it actually measures.
How long should an AI pilot run before it goes to production?
Long enough to run 100 to 300 real cases against a pass mark agreed before the test started. That is a test-set question, not a calendar question. If your volume produces that many cases in two weeks, two weeks is enough. If the pilot has run for months with no pass mark, more time will not make it ready.
What percentage of AI pilots make it to production?
It depends on who you ask and what they count. MIT Project NANDA reported 5% of organizations reaching production with enterprise-grade AI systems in 2025. Deloitte's 2026 survey of 3,235 leaders found 25% had moved 40% or more of their pilots into production. S&P Global found the average company scrapped 46% of proofs of concept before production.
Should we switch AI models if our pilot is stalling?
Usually not first. RAND ranks immature technology last among the root causes of AI project failure. Check the cheaper causes before the expensive one: whether a success number was agreed in advance, whether the pilot runs on live systems, whether one person owns the outcome, and whether controls exist that a risk committee could approve.
What is a pass mark for an AI pilot?
A pass mark is the threshold a pilot must hit on a fixed set of real cases before it is allowed into production, such as 90% correct routing on 200 recent tickets. It must be written down before testing starts. Set after the results, it gets moved to fit them, and then it is not a test.
Can a failed AI pilot be rescued?
Often, if the failure is in scope, data access, ownership or controls rather than the use case itself. The first step is a diagnosis on real cases, not a rebuild. Our AI Rescue service triages shipped AI in 48 hours and ends in a written verdict: fix it, rebuild it, or retire it.

Sources

  1. The GenAI Divide: State of AI in Business 2025. MIT Project NANDA
  2. MIT Report Finds Most AI Business Investments Fail, Reveals GenAI Divide (2025). Virtualization Review
  3. Coverage of S&P Global Market Intelligence AI survey (March 2025). CIO Dive
  4. State of AI in the Enterprise 2026 (n=3,235). Deloitte
  5. The State of AI 2026 (n=1,719). McKinsey & Company
  6. Gartner Predicts Over 40% of Agentic AI Projects Will Be Canceled by End of 2027 (2025). Gartner
  7. 2026 AI Impact Survey (n=950). Grant Thornton
  8. The Root Causes of Failure for Artificial Intelligence Projects and How They Can Succeed (2024). RAND Corporation

One workflow. One owner. One number.

Tell us the workflow and the number it should move. We test on 100 to 300 of your real cases against a pass mark agreed before we build, then ship with spend limits, retry limits and a kill switch in place.

No obligation. A person replies within one business day.
Or send us a pilot that already stalled