The Information Machine

Is AI Demand a Structural Shift or a Hype Cycle? · history

Version 3

2026-05-23 04:46 UTC · 70 items

What

The AI structural-versus-hype debate is being tested by competing empirical signals across three domains. TSMC's CoWoS advanced packaging demand has recovered sharply from its mid-2025 60% utilization trough: capacity is now being 'snapped up' [3], Nvidia alone has secured approximately 60% of available CoWoS supply [4], and ASPs are rising toward 7nm-wafer-equivalent levels [6]—developments that weaken the key bearish signal investor Gavin Baker had identified [2]. Offsetting this, enterprise AI deployment is deteriorating: Gartner predicts over 40% of agentic AI projects will be canceled by end of 2027 [10], and multiple analyses document systemic ROI failures driven by hidden costs and implementation gaps [11][12]. A third element—power and grid infrastructure constraints—is now actively halting data center growth in 2026 [14], introducing a physical bottleneck that neither the structural-demand nor hype-cycle framing had previously addressed.

Why it matters

The TSMC demand recovery strengthens the case that hyperscaler AI conviction is genuine and supply-constrained rather than speculative. But Gartner's cancellation forecast and the growing enterprise failure record create a widening divergence: semiconductor demand may be structurally real at the hyperscaler tier while the broad enterprise productivity gains needed to ultimately justify trillion-dollar infrastructure investment continue to lag. Power grid constraints add further ambiguity—they may moderate speculative overbuilding or produce a new class of stranded capital when construction commitments outpace grid interconnection timelines.

Open questions

  • Nvidia securing approximately 60% of CoWoS capacity [4] and reports that supply is being fully 'snapped up' [3] appear to resolve the mid-2025 utilization gap [1] in the bullish direction—but does concentrated hyperscaler demand reflect genuine AI workload consumption, or preemptive capacity reservation that itself risks overshooting?

  • Gartner's prediction that 40%+ of agentic AI projects will be canceled by 2027 [10] raises the question of whether enterprise deployment will scale sufficiently to validate the infrastructure buildout—or whether hyperscaler demand and enterprise adoption will decouple structurally, with the former remaining strong while the latter stalls.

  • Power and grid constraints are reported to be halting data center growth in 2026 [14], and S&P Global identifies grid dependency as a growing financial vulnerability [15]—does physical energy scarcity function as a natural cap on speculative overbuilding, or as a new category of stranded-asset risk when construction commitments outpace grid access?

  • CoWoS ASPs rising to near 7nm-wafer-equivalent levels [6] signal strong pricing power in advanced packaging—does this reflect genuine supply scarcity consistent with structural AI demand, or does it indicate TSMC is extracting rents from hyperscalers locked into near-term capacity constraints regardless of end-demand fundamentals?

Narrative

The debate over whether artificial intelligence represents a structural shift in economic productivity or a speculative investment cycle is now being tested by a new set of empirical data points from the semiconductor supply chain, enterprise deployment records, and physical infrastructure reports.

The most consequential update comes from TSMC's CoWoS advanced packaging market, where the demand picture has shifted materially since mid-2025. A Digitimes report from August 2025 had placed CoWoS capacity utilization at just 60% during the AI boom [1], providing the clearest concrete support for investor Gavin Baker's framework, which identified TSMC's capacity decisions as the primary bubble-detection signal [2]. That utilization gap now appears to have closed: multiple reports indicate CoWoS capacity is being 'snapped up' [3], Nvidia has secured approximately 60% of available CoWoS supply [4], and TSMC is expanding Chip-on-Wafer orders in the second half of 2026 as outside assembly and test firms develop CoWoS-equivalent alternatives [5]. TrendForce reported in April 2026 that CoWoS wafer average selling prices are approaching 7nm-wafer-equivalent levels, with advanced packaging on track to become a key TSMC profit driver [6]. The combined picture—recovering utilization, concentrated customer demand from the largest GPU buyer in the market, and improving ASPs—suggests that semiconductor demand at the hyperscaler tier is neither softening nor speculative but tightening.

SemiAnalysis, which has consistently argued the structural-demand case, grounds its thesis in internal workflow economics rather than semiconductor-market data. The firm reports that every AI-assisted task delivered at least 10x return on investment in tokens spent, with most in the 60–90x range, citing a specific figure of approximately $21 in compute costs replacing 20 hours of human labor [7][8]. SemiAnalysis also draws a historical analogy to the industrialization of screw manufacturing—which moved production from hundreds of units per day to trillions—to argue that AI's economic impact will come not primarily from cheapening existing tasks but from making entirely new application categories economically viable for the first time [9]. On this view, the infrastructure buildout is not racing ahead of demand but lagging behind a set of latent applications not yet attempted.

Enterprise deployment data challenges the generalizability of that argument and has grown markedly more negative. Gartner has predicted that more than 40% of agentic AI projects will be canceled by the end of 2027, citing implementation complexity, unclear ROI measurement, and governance gaps [10]. Forbes published analysis in March 2026 identifying hidden costs—data preparation, integration, ongoing maintenance, and employee retraining—as systematically eroding the headline ROI figures that enterprises report during pilots [11]. Separate analyses place enterprise AI project failure rates as high as 95% for scaling attempts [12], with root causes frequently traced to inadequate data infrastructure rather than model quality [13]. The aggregate picture is a growing divergence: hyperscaler demand for compute is tightening while enterprises beneath that tier are canceling, pausing, or failing to scale AI deployments.

A structurally new element in the debate is the emergence of physical power and grid infrastructure as a binding constraint on data center growth. Reports indicate that electrical grid capacity limitations are actively halting data center expansion in 2026 [14], and S&P Global has identified rapid data center development as generating new financial vulnerabilities through increasing grid dependency [15]. This constraint does not fit neatly into either the structural-demand or hype-cycle framing: genuine AI demand could be structurally real at the hyperscaler level while remaining physically constrained by permitting timelines and grid interconnection queues, potentially creating a scenario where capital commitments outpace deployable capacity regardless of whether demand is cyclical or durable.

Timeline

  • 2025-06-25: Gartner predicts over 40% of agentic AI projects will be canceled by end of 2027, citing implementation difficulty, unclear ROI, and governance gaps [10]
  • 2025-08-05: Digitimes reports CoWoS capacity utilization at only 60% amid the AI boom, suggesting AI-driven demand has not kept pace with packaging supply buildout [1]
  • 2025-12-15: Digitimes reports TSMC plans to expand Chip-on-Wafer orders in second half of 2026 as OSAT firms develop CoWoS-equivalent alternatives [5]
  • 2026-01-30: Guardian publishes commentary arguing the AI bubble will pop and that responsibility lies in managing the transition responsibly [24]
  • 2026-02-05: Report published that TSMC will quadruple advanced packaging capacity to 130,000 CoWoS wafers monthly by late 2026 [28]
  • 2026-02-27: Forbes characterizes the AI buildout as a '$1.7 trillion bubble' in analysis titled 'The End of Thinking' [21]
  • 2026-03-12: Forbes publishes analysis identifying hidden costs—integration, maintenance, retraining, data preparation—as systematically undermining enterprise AI ROI [11]
  • 2026-03-26: Time publishes analysis calling on investors and policymakers to prepare for an AI bubble now [23]
  • 2026-04: NY Fed and CEPR publish academic framework examining AI's cyclical vs. structural transmission effects on monetary policy and financial stability [37][38][39]
  • 2026-04-28: TrendForce reports CoWoS wafer ASPs approaching 7nm-wafer-equivalent levels, with advanced packaging positioned as a key TSMC profit driver [6]
  • 2026-05-18: SemiAnalysis publishes internal token-spend ROI data, reporting 10–90x returns on AI-assisted tasks and arguing demand is structural [7][8]
  • 2026-05-20: Milk Road AI summarizes Gavin Baker's framework: watch TSMC capacity decisions as the primary bubble-detection signal for AI investment [2]
  • 2026-05-21: SemiAnalysis draws screw-manufacturing analogy to argue AI's transformative impact comes from unlocking new use cases, not cheapening existing ones [9]
  • 2026-05-21: Digitimes publishes investor analysis arguing TSMC's cautious capex approach is actively averting an AI bubble rather than feeding one [27]
  • 2026-05: Multiple reports indicate TSMC CoWoS capacity is being 'snapped up,' with Nvidia securing approximately 60% of available supply and ASPs rising sharply [3][4]
  • 2026-05: Reports emerge that power and grid constraints are halting AI data center growth, with S&P Global identifying grid dependency as a growing financial vulnerability [14][15]

Perspectives

SemiAnalysis

Strongly structural and bullish. Internal ROI data (10–90x) and historical price-deflation analogies argue that AI adoption is economically irreversible and categorically different from prior hype cycles.

Evolution: Consistent across all items in this thread.

Gavin Baker

Analytically neutral with a risk-aware lean. Accepts AI as a genuine breakthrough but applies a historical pattern—breakthroughs attract capital that overshoots—and identifies TSMC capacity decisions as the key signal for detecting divergence between fundamentals and speculation.

Evolution: Framework is consistent, but the TSMC utilization signal he identified as the primary bubble indicator now appears to be resolving bullishly: Nvidia has secured 60% of CoWoS capacity and utilization has recovered from the mid-2025 trough, meaning his proposed warning signal has not triggered.

Bearish media consensus (Forbes, Time, Guardian, Medium, WEF)

The AI buildout represents speculative overshoot. Forbes frames it as a $1.7 trillion bubble and identifies hidden costs undermining enterprise ROI; Time calls for preemptive preparation; the Guardian argues the bubble will pop; the WEF examines realistic burst scenarios.

Evolution: Reinforced with a new Forbes analysis specifically targeting enterprise ROI erosion through hidden costs, adding micro-level evidence to a previously macro-level bubble argument.

TSMC and supply-chain data

The mixed signal from mid-2025—aggressive capacity expansion alongside 60% utilization—has tilted decisively bullish. Capacity is being snapped up, Nvidia is securing the majority of supply, ASPs are rising toward 7nm-equivalent levels, and TSMC is expanding CoW orders for 2H26.

Evolution: Significant update from the previous pass: the 60% utilization figure from August 2025 represented a temporary demand-supply gap that appears to have since closed, substantially weakening the most concrete bearish empirical signal in the debate.

Enterprise adoption data (Gartner, Writer.com, iris.ai, Forbes)

Substantially negative. Gartner predicts 40%+ of agentic AI projects will be canceled by 2027; iris.ai reports 95% failure rates for enterprise AI scaling attempts; Forbes identifies hidden costs systematically eroding ROI. Some positive ROI studies exist but appear to represent best-case implementations rather than typical outcomes.

Evolution: Markedly more negative this pass, driven by Gartner's high-profile cancellation forecast and additional granular failure analysis. The aggregate enterprise picture has shifted from 'uneven adoption' to 'predominantly struggling to scale.'

Academic and policy community (NY Fed, CEPR)

Treats AI's structural vs. cyclical economic impact as a formal empirical question with implications for monetary policy and financial stability. Neither bullish nor bearish—focused on risk modeling and systemic assessment.

Evolution: Consistent.

Infrastructure risk analysts (S&P Global, enkiai.com)

Power and grid constraints are emerging as a binding physical bottleneck on AI data center growth in 2026, generating new categories of financial vulnerability distinct from both the demand-side structural question and the capital-cycle bubble question.

Evolution: New perspective in this pass—physical energy infrastructure as a constraint on the AI buildout was absent from prior versions of this debate.

Tensions

  • Micro-level productivity economics vs. macro-level capital cycle risk: SemiAnalysis argues that 60–90x task-level ROI makes AI adoption behaviorally irreversible, implying demand is structurally sound [7][8]. Baker's framework counters that strong underlying economics do not preclude speculative overshoot—genuine breakthroughs have historically still produced capital bubbles [2]. The TSMC utilization recovery partially favors the structural side, but Baker's framework was designed precisely to warn that even genuine breakthroughs can attract misallocated capital. [7][8][2][4]
  • Hyperscaler semiconductor demand vs. enterprise deployment failure: TSMC's CoWoS capacity is being secured at the hyperscaler tier—Nvidia holds roughly 60% of supply [4], utilization has recovered from 60% in mid-2025 [1]—while enterprise AI deployment is deteriorating, with Gartner predicting 40%+ of agentic projects canceled by 2027 [10]. The structural demand thesis requires productivity gains to replicate broadly, but hyperscaler conviction and enterprise deployment outcomes are diverging rather than converging. [4][1][10][7]
  • Internal firm ROI data vs. systematic enterprise failure rates: SemiAnalysis's 60–90x ROI claims derive from its own research-intensive workflows [7], but third-party analyses place enterprise AI project failure rates at 95% for scaling attempts [12] and Gartner predicts 40%+ of agentic AI projects will not survive to full deployment [10]. These bodies of evidence cannot simultaneously be representative—either research-intensive workflows are unrepresentative outliers or the failure-rate analyses are capturing structurally avoidable implementation errors. [7][8][12][10]
  • Physical infrastructure constraints as bubble-prevention vs. new stranded-asset risk: Power and grid limitations are halting data center growth in 2026 [14], which could moderate the speculative overbuilding that Baker's framework warns against [2], or could instead create a new class of stranded capital when committed construction investment outpaces actual grid access timelines [15]. [14][15][2]

Sources

  1. [1] CoWoS capacity utilization reportedly only 60% amid AI boom ... — reactive:ai-demand-bubble-debate
  2. [2] Gavin Baker just gave the clearest framework for tracking whether the AI cycle turns into a bubble. — Milk Road AI Twitter (2026-05-20)
  3. [3] TSMC's packaging capacity is being snapped up. - EEWorld — reactive:ai-demand-bubble-debate
  4. [4] Nvidia Secures 60% of CoWoS Capacity - Astute Group — reactive:ai-demand-bubble-debate
  5. [5] TSMC to expand CoW Orders in 2H26 as OSAT CoWoS-like tech rises — reactive:ai-demand-bubble-debate
  6. [6] [News] TSMC CoWoS Wafer ASP Reportedly Nears 7nm; Advanced Packaging to Become a Key Profit Driver — reactive:ai-demand-bubble-debate
  7. [7] The ROI on every single task was over 10x. Most were 60-90x. This is why the demand isn't cyclical - once you see that a… — SemiAnalysis Twitter (2026-05-18)
  8. [8] Our SemiAnalysis Weekly Podcast often asks - Is the AI cycle this time truly different from other cycles? Well, at least… — SemiAnalysis Twitter (2026-05-18)
  9. [9] AI is not the first technology to drop prices by multiple orders of magnitude. When screws were handmade, output was cou… — SemiAnalysis Twitter (2026-05-21)
  10. [10] Gartner: Over 40% of Agentic AI Projects Will Be Canceled by End ... — reactive:ai-demand-bubble-debate
  11. [11] The Hidden Costs That Are Undermining Enterprise AI ROI — reactive:ai-demand-bubble-debate
  12. [12] Why 95% of Enterprise AI Projects Fail, And How to Fix It - Iris.ai — reactive:ai-demand-bubble-debate
  13. [13] AI Foundation Problem: Why Most Companies Are Failing to See ROI — reactive:ai-demand-bubble-debate
  14. [14] AI Data Center Grid Strain: Power Halts Growth in 2026 — reactive:jensen-huang-nvidia-thesis
  15. [15] From Growth To Growing Risk: Rapid Development Of - S&P Global — reactive:ai-demand-bubble-debate
  16. [16] AI Value Capture - The Shift To Model Labs - SemiAnalysis — reactive:ai-demand-bubble-debate
  17. [17] Tokenomics Model - SemiAnalysis — reactive:ai-demand-bubble-debate
  18. [18] Gavin Baker on Orbital Compute, TSMC, and Frontier Models — reactive:ai-demand-bubble-debate
  19. [19] Gavin Baker on Orbital Compute, TSMC, and Frontier Models — reactive:ai-demand-bubble-debate
  20. [20] 1 Semiconductor Expert Gavin Baker: "China's Not Getting Taiwan's ... — reactive:ai-demand-bubble-debate
  21. [21] The State Of The $1.7 Trillion AI Bubble: The End Of Thinking — reactive:ai-demand-bubble-debate
  22. [22] 2026, the Last Year of the Bubble: The AI Empire Begins to Crumble — reactive:ai-demand-bubble-debate
  23. [23] We Must Prepare For an AI Bubble Now — reactive:ai-demand-bubble-debate
  24. [24] The AI bubble will pop. It’s up to us to replace it responsibly | Mark Surman | The Guardian — reactive:ai-demand-bubble-debate
  25. [25] Is the AI bubble about to burst? 2026 feels like déjà vu… : r/AI_Agents — reactive:ai-demand-bubble-debate
  26. [26] Anatomy of an AI reckoning | World Economic Forum — reactive:ai-demand-bubble-debate
  27. [27] TSMC's cautious capex is averting an AI bubble, says investor — reactive:ai-demand-bubble-debate
  28. [28] TSMC to Quadruple Advanced Packaging Capacity: Reaching 130,000 CoWoS Wafers Monthly by Late 2026 — reactive:ai-demand-bubble-debate
  29. [29] TSMC in 2026: Full Power On, Racing to Max Out Capacity — reactive:ai-demand-bubble-debate
  30. [30] TSMC Expands CoWoS Capacity 80% by 2026 | Kit Yu posted on the topic | LinkedIn — reactive:ai-demand-bubble-debate
  31. [31] TSMC to expand CoW Orders in 2H26 as OSAT CoWoS-like tech ... — reactive:ai-demand-bubble-debate
  32. [32] AI ROI in 2026: Why Enterprise AI Fails & Works | Terminal X — reactive:big-tech-q1-2026-cloud-earnings
  33. [33] Enterprise AI ROI Shifts as Agentic Priorities Surge - Futurum — reactive:ai-agents-hype-reality
  34. [34] The 2026 Enterprise AI ROI Guide: Metrics, Benchmarks & P&L Impact | linesNcircles — reactive:ai-agents-hype-reality
  35. [35] Study Finds 370% ROI for Enterprise Generative AI - YouTube — reactive:ai-demand-bubble-debate
  36. [36] Enterprise AI adoption in 2026: Why 79% face challenges despite ... — reactive:ai-demand-bubble-debate
  37. [37] [PDF] Artificial intelligence and monetary policy - NYU Stern — reactive:ai-demand-bubble-debate
  38. [38] DP21248 Artificial Intelligence and Monetary Policy: A Framework and Perspective on Cyclical Transmission, Structural Transition, and Financial Stability | CEPR — reactive:ai-demand-bubble-debate
  39. [39] Artificial Intelligence and Monetary Policy: A Framework and ... — reactive:ai-demand-bubble-debate
  40. [40] 8 Ways AI Will Rewrite Data Center Infrastructure in 2026 - TechArena — reactive:ai-demand-bubble-debate
  41. [41] Will There Be an AI Data Center Bubble in 2026? A Deep Dive into ... — reactive:ai-demand-bubble-debate
  42. [42] 2026 Hyperscaler AI Buildout: Data Centers, GPUs and the Global ... — reactive:ai-demand-bubble-debate
  43. [43] AI Data Center Market 2026-2035: Capacity Boom, Cooling Crisis ... — reactive:ai-demand-bubble-debate