AI Agents: 24x Token Growth Projections, Enterprise Cost Pressure, and the Agentic Business Thesis · history
Version 3
2026-06-28 02:29 UTC · 103 items
What
Goldman Sachs projects 24x AI agent token growth by 2030 [1], McKinsey projects agents could mediate $3-5 trillion in global retail commerce over the same period [3], and OpenAI's internal data shows non-developer agent use grew 137x for individuals and 189x for organizations since August 2025 [2]. SemiAnalysis adds real-time financial corroboration: Anthropic's ARR grew from $9B to over $44B and gross margins rose from 38% to over 70% in the same period, which SemiAnalysis attributes to AI labs becoming the primary value captors in the AI ecosystem [4]. The enterprise cost counter-narrative — Microsoft and Uber reportedly reconsidering expensive agent deployments [8][9] — is complicated by SemiAnalysis's unit economics finding that real agentic workloads run at 300:1 input-to-output ratios with 90%+ cache hit rates, reducing effective Opus 4.7 cost to roughly $0.99 per million tokens against a $5/$25 sticker price [6].
Why it matters
If effective token costs in optimized agentic deployments are already far below sticker prices, the enterprise pullback story may reflect a configuration or accounting problem rather than a structural ceiling. AI lab gross margin expansion reaching 70%+ while ARR grows rapidly suggests the demand-volume effect is already outpacing price compression — which is the Goldman thesis playing out in real financial results rather than projections.
Open questions
SemiAnalysis reports effective Opus 4.7 costs near $0.99/million tokens for optimized agentic workloads [6] — are the enterprises reportedly pulling back on cost grounds (Microsoft, Uber) using actual blended costs or sticker prices in their ROI calculations?
SemiAnalysis's own token spend equals roughly 30% of employee compensation and they argue research firms, hedge funds, and law firms are heading toward similar ratios [7] — is there external evidence from those industries that this migration is underway at scale?
If Microsoft is pulling back on agent deployment costs [1] while simultaneously expanding Copilot in Excel with new finance workflow capabilities [11], do different Microsoft product teams operate on different cost assumptions, or are the two reports describing different deployment contexts?
McKinsey's $3-5 trillion retail commerce projection requires brands to expose inventory and pricing via APIs to remain discoverable by AI purchasing agents [3] — is there observable evidence that retailers are moving toward machine-readable infrastructure at scale?
Narrative
Goldman Sachs Research's projection that AI agent token usage will grow 24-fold by 2030 [1] is now reinforced by both quantitative demand data and real-time financial evidence of lab-side value capture. On the demand side, OpenAI's June 25 economic research paper documented that Codex went from below 10% to approximately 99.8% of the company's internal output tokens in under a year [2]. Non-developer use of agents at OpenAI grew 137x for individuals and 189x for organizations between August 2025 and publication, and 70.2% of sampled users submitted at least one request representing more than one hour of equivalent human work [2]. McKinsey projected a separate demand ceiling: AI agents could mediate between $3 trillion and $5 trillion of global consumer retail commerce by 2030, with the highest-level scenario involving AI agents negotiating directly with retailer AI agents on price and shipping [3].
SemiAnalysis published an AI Value Capture analysis on June 27 that adds structural grounding to the growth projections. The firm reports Anthropic's ARR grew from $9 billion to over $44 billion and gross margins rose from 38% to over 70% in the same period, which they attribute to AI labs becoming the primary value captors in the AI ecosystem — a position they describe as a recent and structural shift [4]. The throughput math: on a B300 GPU running DeepSeek R1, baseline FP8 achieves roughly 1,000 tokens per second per GPU; adding wideEP plus disaggregation reaches 8,000; layering MTP on top reaches 14,000 — a 14x gain from software alone [5]. SemiAnalysis's own unit economics show effective Opus 4.7 cost near $0.99 per million tokens against a $5/$25 sticker price, because agentic workloads run at roughly 300:1 input-to-output ratios and cache hit rates above 90% [6]. The firm's internal token spend now equals approximately 30% of total employee compensation, with employees averaging just under 5 billion tokens per month — over 5x Meta's per-employee average — and top contributors each clearing roughly 100 billion tokens per month [7].
The enterprise cost counter-narrative has corroboration but is complicated by the SemiAnalysis unit economics. Microsoft and Uber are reported to be reconsidering AI agent deployments that cost more than equivalent human workers [8][9][10]. Against this, Microsoft also expanded Copilot in Excel into a finance workflow system, adding external data connectors to FactSet, Morningstar, PitchBook, and S&P/Kensho and introducing SKILL.md-defined repeatable workflows with a Plan mode requiring pre-edit declarations and a Show Changes audit trail [11]. Whether the reported pullbacks reflect deployments priced at sticker rates rather than the optimized blended costs SemiAnalysis observes is unresolved in the current reporting.
Two other data points register the transition's breadth. DeepMind integrated computer use directly into Gemini 3.5 Flash on June 24, previously available only as a standalone product, pairing the expansion with adversarial training against prompt injection and confirmation gates for irreversible actions [12]. Notion announced it will shut down Notion Mail on September 22, 2026, citing that most of its users rely on AI agents for electronic correspondence rather than email clients [13] — an early instance of a company naming agent adoption as the direct cause of a product discontinuation, though the claim is asserted by Notion and not independently verified.
Timeline
- 2026-05-30: Goldman Sachs 24x AI agent token forecast publicized; reports note Uber and Microsoft are already reconsidering expensive agent deployments on cost grounds. [1]
- 2026-06-19: Eric Schmidt quote — 'if you really want to make money, found an agentic AI company' — begins circulating widely. [22][26]
- 2026-06-24: DeepMind integrates computer use into Gemini 3.5 Flash with adversarial prompt-injection training and confirmation gates for irreversible actions. [12]
- 2026-06-25: OpenAI publishes 'How agents are transforming work'; Codex reported at 99.8% of internal output tokens, up from below 10% a year earlier. [18][2]
- 2026-06-25: OpenAI internal data: non-developer individual agent use grew 137x and organizational use grew 189x since August 2025; 70.2% of users submitted requests exceeding one hour of human work. [2]
- 2026-06-25: Microsoft upgrades Copilot in Excel with external data connectors to FactSet, Morningstar, and others; SKILL.md-defined finance workflows and Plan mode with pre-edit declarations. [11]
- 2026-06-25: McKinsey projects AI agents could mediate $3-5 trillion of global retail consumer commerce by 2030, requiring brands to expose machine-readable APIs to remain agent-discoverable. [3]
- 2026-06-25: Notion announces shutdown of Notion Mail on September 22, 2026, citing that most users rely on AI agents for email rather than dedicated clients. [13]
- 2026-06-25: Multiple articles confirm Microsoft and Uber find AI agent deployments more expensive than equivalent human workers. [8][9][10]
- 2026-06-27: SemiAnalysis publishes AI Value Capture piece: Anthropic ARR grew from $9B to over $44B; gross margins rose from 38% to over 70%; AI labs now capture most value in the AI stack. [4]
- 2026-06-27: SemiAnalysis: B300 GPU software optimization alone achieves 14x throughput gain on DeepSeek R1; model-lab gross margin expansion is structural, not a temporary pricing anomaly. [5]
- 2026-06-27: SemiAnalysis: effective Opus 4.7 cost ~$0.99/million tokens due to 300:1 input/output ratios and 90%+ cache hit rates; tasks that took analyst hours now complete in minutes for a few dollars. [6]
- 2026-06-27: SemiAnalysis discloses internal token spend equals ~30% of employee compensation; employees average ~5B tokens/month, over 5x Meta's per-employee average. [7]
Perspectives
Goldman Sachs Research
Projects 24x AI agent token demand growth by 2030; expects token cost declines to outpace price reductions, positioning cloud providers near a gross-margin turning point.
Evolution: Consistent — the originating analytical source for the thread's central forecast.
SemiAnalysis
AI labs now capture most value in the AI stack; Anthropic's margins rose from 38% to 70%+ as ARR grew from $9B to $44B+; effective agentic token costs (~$0.99/M for Opus 4.7) are far below sticker prices due to high cache hit rates and input-heavy workload ratios; margin expansion is structural because hardware and software compression together make it durable.
Evolution: New voice in this pass; provides original financial and throughput data that bridges the Goldman demand forecast and the enterprise cost counter-narrative.
McKinsey
Projects AI agents will mediate $3-5 trillion of global retail commerce by 2030; argues brands must adopt machine-readable API infrastructure or be bypassed by AI purchasing agents.
Evolution: Consistent; entered one pass prior.
OpenAI
Presents internal research showing agents enabling longer and more complex tasks across professional roles; internal data shows Codex at 99.8% of token output and 137x growth in non-developer individual use since August 2025.
Evolution: Consistent with public advocacy for agentic AI; June 25 paper is the first publication of specific internal usage statistics in this thread.
DeepMind / Google
Frames enterprise computer use as a natural extension of Gemini's existing capabilities; pairs capability expansion with defense-in-depth safety including adversarial training and confirmation gates for irreversible actions.
Evolution: Consistent; entered one pass prior as a direct competitor to OpenAI and Microsoft in enterprise agent infrastructure.
Microsoft
Simultaneously reported as pulling back on expensive AI agent deployments due to cost, and actively expanding Copilot in Excel with finance workflow capabilities and audit features.
Evolution: The cost-pullback was first reported in May 2026; the Excel Copilot expansion from June 25 remains an unresolved apparent contradiction within the same company.
Eric Schmidt (ex-Google CEO)
Strongly bullish on agentic AI as a near-term business opportunity; predicts all businesses will build competing agents, implicitly acknowledging future margin compression.
Evolution: Consistent; widely amplified across social platforms in the week of June 19-25.
Enterprises (Uber and others)
Reporting that AI agent deployments cost more than equivalent human workers, resulting in pullback from some agent subscriptions.
Evolution: Consistent counter-narrative; the SemiAnalysis finding that effective costs for optimized deployments are far below sticker prices creates an unresolved question about whether these enterprises are using actual blended costs in their calculations.
Tensions
- Goldman Sachs and McKinsey project multi-trillion-dollar economic impact from agent adoption by 2030; Microsoft and Uber report that current agent deployments cost more than equivalent human workers. [1][14][3][8][9][10]
- SemiAnalysis reports effective Opus 4.7 costs near $0.99/million tokens for optimized agentic workloads; enterprises citing agent costs as prohibitive appear to be using a different cost basis — whether sticker pricing or suboptimal deployment configurations is not specified in the available reports. [6][8][9][10]
- Microsoft is both pulling back on expensive AI agent deployments on cost grounds and simultaneously expanding Copilot in Excel with new finance workflow capabilities — the two positions may reflect different product lines or cost assumptions within the same company. [1][14][11][8]
- OpenAI's research frames agents as broadly transformative across professional roles including legal and finance; the internal token data showing Codex at 99.8% of output suggests current value is concentrated in software development. [18][2]
- SemiAnalysis argues AI labs now capture most value in the stack and that margin expansion is structural; the Goldman Sachs thesis implies cloud infrastructure providers will also benefit as demand grows — whether lab value capture comes at infrastructure providers' expense is unresolved. [4][5][1]
- Notion cites AI agent adoption as the direct reason for shutting down its email client; the claim is asserted by Notion and not independently verified. [13]
Sources
- [1] Goldman Sachs: "Token use by AI agents is expected to multiply 24 times by 2030" — Rohan Paul Twitter (2026-05-30)
- [2] OpenAI just released a paper showing how they are now seeing the first version of office work where agents do most of th… — Rohan Paul Twitter (2026-06-25)
- [3] Mckinsey report - AI agents are quietly taking over the retail shopping cart and could mediate $3 Tn to $5 tn of global … — Rohan Paul Twitter (2026-06-25)
- [4] If you are an operator trying to write down what tokens will cost in 2027, the answer is materially lower than today, an… — SemiAnalysis Twitter (2026-06-27)
- [5] The throughput math has gotten the most pushback in our reader notes, so its worth being precise. On the same B300 runni… — SemiAnalysis Twitter (2026-06-27)
- [6] The substitution math is the part to internalize. Tasks that used to need a junior analyst for several hours, converting… — SemiAnalysis Twitter (2026-06-27)
- [7] One of the more uncomfortable observations in our AI Value Capture piece is internal: our token spend at SemiAnalysis no… — SemiAnalysis Twitter (2026-06-27)
- [8] AI promised cost savings, but Microsoft and Uber say it’s costing more than human workers | Company Business News — reactive:ai-agent-economics-enterprise
- [9] Microsoft and Uber Pull Back on AI Subscriptions Due to Cost and ... — reactive:ai-agent-economics-enterprise
- [10] Uber, Microsoft, and Others Burning Through AI Budgets. Now What? — reactive:ai-agent-economics-enterprise
- [11] Microsoft just turned Copilot in Excel into a finance workflow system — Rohan Paul Twitter (2026-06-25)
- [12] Introducing computer use in Gemini 3.5 Flash — DeepMind Blog (2026-06-24)
- [13] Notion killing Skiff-influenced email app since most users use AI agents instead — Ars Technica AI (2026-06-25)
- [14] Goldman Sachs Research: "Token use by AI agents is expected to multiply 24 times by 2030" — Rohan Paul Twitter (2026-06-25)
- [15] Goldman Sachs Forecasts 24x AI Token Demand by 2030 — Enterprise DNA — reactive:ai-agent-economics-enterprise
- [16] Goldman Sachs: AI Agents Could Skyrocket Token Demand 24x — reactive:ai-agent-economics-enterprise
- [17] Goldman Sachs deciphers the AI agent economy: The decline in token costs will outpace price reductions, and cloud providers are approaching a turning point in gross margins. — reactive:ai-agent-economics-enterprise
- [18] How agents are transforming work — OpenAI Blog (2026-06-25)
- [19] OpenAI Replaces Custom GPTs With Workspace Agents Built for Team Workflows — reactive:ai-agent-economics-enterprise
- [20] AI Agents Set to Transform Workplaces in 2025, Says OpenAI CEO — reactive:ai-agent-economics-enterprise
- [21] "If you really want to make money, found an agentic AI company. — Rohan Paul Twitter (2026-06-25)
- [22] Eric Schmidt (ex-Google CEO): “if you really want to make money, it’s actually easy. found an agentic AI company” — reactive:ai-agent-economics-enterprise (2026-06-24)
- [23] Eric Schmidt, Ex Google CEO. — reactive:ai-agent-economics-enterprise
- [24] Ex-Google CEO Eric Schmidt says, “If you really want to make ... — reactive:ai-agent-economics-enterprise
- [25] Eric Schmidt: Build AI Agents, Get Rich - YouTube — reactive:ai-agent-economics-enterprise
- [26] RT @cyrilXBT: Eric Schmidt (ex-Google CEO): “if you really want to make money, it’s actually easy. found an agentic AI c... — reactive:ai-agent-economics-enterprise (2026-06-19)