The Information Machine

AI Agents: 24x Token Growth Projections, Enterprise Cost Pressure, and the Agentic Business Thesis · history

Version 5

2026-06-30 18:50 UTC · 118 items

What

Goldman Sachs projects 24x AI agent token growth by 2030 [1], a forecast grounded in real financial evidence: Anthropic's ARR grew from $9B to over $44B and gross margins rose from 38% to over 70% in the same period [4]. OpenAI's internal data shows Codex reached roughly 99.8% of the company's output tokens within a year of launch, and non-developer agent use grew 137x for individuals and 189x for organizations since August 2025 [2]. The central unresolved tension is between this expansion data and reports that Microsoft and Uber are reconsidering agent deployments they find more expensive than equivalent human workers [8][9] — a tension complicated by SemiAnalysis's finding that effective costs for optimized agentic workloads run near $0.99 per million tokens, far below sticker prices [6].

Why it matters

If effective agentic token costs in optimized deployments are already far below sticker prices, the enterprise pullback story may reflect a configuration or accounting problem rather than a structural ceiling. AI lab gross margin expansion to 70%+ while ARR grows rapidly suggests demand volume is already outpacing price compression — the Goldman thesis playing out in current financials rather than projections.

Open questions

  • SemiAnalysis reports effective Opus 4.7 costs near $0.99/million tokens for optimized agentic workloads [6] — are the enterprises reportedly pulling back (Microsoft, Uber) using actual blended costs or sticker prices in their ROI calculations?

  • SemiAnalysis's own token spend equals roughly 30% of employee compensation and they argue research firms, hedge funds, and law firms are heading toward similar ratios [7] — is there external evidence from those industries that this migration is underway at scale?

  • McKinsey's $3-5 trillion retail commerce projection requires brands to expose inventory and pricing via machine-readable APIs to remain agent-discoverable [3] — is there observable evidence that retailers are moving toward this infrastructure at scale?

  • Outcome-driven agent products like Scout route high-stakes changes (money, external integrations) to human approval before deployment [14] — does this human-in-the-loop constraint limit achievable ROI in ways that the cost-benefit comparisons between agents and human workers do not capture?

Narrative

Goldman Sachs Research's projection that AI agent token usage will grow 24-fold by 2030 [1] is reinforced by both quantitative demand data and real-time financial evidence of lab-side value capture. OpenAI's June 25 economic research paper documented that Codex went from below 10% to approximately 99.8% of the company's internal output tokens in under a year [2]. Non-developer use of agents grew 137x for individuals and 189x for organizations between August 2025 and publication, and 70.2% of sampled users submitted at least one request representing more than one hour of equivalent human work [2]. McKinsey projected a separate demand ceiling: AI agents could mediate between $3 trillion and $5 trillion of global consumer retail commerce by 2030, with the highest-level scenario involving AI agents negotiating directly with retailer AI agents on price and shipping [3].

SemiAnalysis published an AI Value Capture analysis that adds structural grounding to the growth projections. The firm reports Anthropic's ARR grew from $9 billion to over $44 billion and gross margins rose from 38% to over 70%, which they attribute to AI labs becoming the primary value captors in the ecosystem [4]. On a B300 GPU running DeepSeek R1, software optimization alone — wideEP, disaggregation, and MTP layered sequentially — achieves a 14x throughput gain, making margin expansion durable rather than a temporary pricing anomaly [5]. Effective Opus 4.7 cost for real agentic workloads runs near $0.99 per million tokens against a $5/$25 sticker price, because those workloads run at roughly 300:1 input-to-output ratios and achieve cache hit rates above 90% [6]. SemiAnalysis's own internal token spend equals approximately 30% of total employee compensation, with employees averaging just under 5 billion tokens per month — over 5x Meta's per-employee average [7].

The enterprise cost counter-narrative has corroboration but is complicated by those unit economics. Microsoft and Uber are reported to be reconsidering AI agent deployments that cost more than equivalent human workers [8][9][10]. Against this, Microsoft also expanded Copilot in Excel with external data connectors to FactSet, Morningstar, PitchBook, and S&P/Kensho and introduced SKILL.md-defined finance workflows with a Plan mode requiring pre-edit declarations and a Show Changes audit trail [11]. Whether the reported pullbacks reflect deployments priced at sticker rates rather than the optimized blended costs SemiAnalysis observes is unresolved in available reporting.

Several product-side developments register where the agent transition is being operationalized. DeepMind integrated computer use directly into Gemini 3.5 Flash on June 24, previously available only as a standalone product, pairing the expansion with adversarial training against prompt injection and confirmation gates for irreversible actions [12]. Notion announced it will shut down Notion Mail on September 22, 2026, citing that most of its users rely on AI agents for electronic correspondence rather than email clients [13]. Scout, announced June 29, illustrates an emerging product pattern: users specify a business KPI in plain English, and the system autonomously builds and tests agents to achieve it, learning from past cases where human representatives had to intervene, and routing changes involving money or external integrations to human approval before deployment [14].

Timeline

  • 2026-05-30: Goldman Sachs 24x AI agent token forecast publicized; reports note Uber and Microsoft are already reconsidering expensive agent deployments on cost grounds. [1]
  • 2026-06-19: Eric Schmidt quote — 'if you really want to make money, found an agentic AI company' — begins circulating widely. [23][27]
  • 2026-06-24: DeepMind integrates computer use into Gemini 3.5 Flash with adversarial prompt-injection training and confirmation gates for irreversible actions. [12]
  • 2026-06-25: OpenAI publishes 'How agents are transforming work'; Codex reported at 99.8% of internal output tokens, up from below 10% a year earlier. [19][2]
  • 2026-06-25: OpenAI internal data: non-developer individual agent use grew 137x and organizational use grew 189x since August 2025; 70.2% of users submitted requests exceeding one hour of human work. [2]
  • 2026-06-25: Microsoft upgrades Copilot in Excel with external data connectors to FactSet, Morningstar, and others; SKILL.md-defined finance workflows and Plan mode with pre-edit declarations. [11]
  • 2026-06-25: McKinsey projects AI agents could mediate $3-5 trillion of global retail consumer commerce by 2030, requiring brands to expose machine-readable APIs to remain agent-discoverable. [3]
  • 2026-06-25: Notion announces shutdown of Notion Mail on September 22, 2026, citing that most users rely on AI agents for email rather than dedicated clients. [13]
  • 2026-06-25: Multiple reports confirm Microsoft and Uber find AI agent deployments more expensive than equivalent human workers. [8][9][10]
  • 2026-06-27: SemiAnalysis: Anthropic ARR grew from $9B to over $44B; gross margins rose from 38% to over 70%; AI labs now capture most value in the AI stack. [4]
  • 2026-06-27: SemiAnalysis: B300 GPU software optimization alone achieves 14x throughput gain on DeepSeek R1; model-lab gross margin expansion is structural, not a temporary pricing anomaly. [5]
  • 2026-06-27: SemiAnalysis: effective Opus 4.7 cost ~$0.99/million tokens due to 300:1 input/output ratios and 90%+ cache hit rates; tasks that took analyst hours now complete in minutes for a few dollars. [6]
  • 2026-06-27: SemiAnalysis discloses internal token spend equals ~30% of employee compensation; employees average ~5B tokens/month, over 5x Meta's per-employee average. [7]
  • 2026-06-29: Scout launches as a KPI-driven agent product: users specify a business goal in plain English; the system builds and tests agents autonomously, with human approval gates for changes involving money or external integrations. [14]

Perspectives

Goldman Sachs Research

Projects 24x AI agent token demand growth by 2030; expects token cost declines to outpace price reductions, positioning cloud providers near a gross-margin turning point.

Evolution: Consistent — the originating analytical source for the thread's central forecast.

SemiAnalysis

AI labs now capture most value in the AI stack; Anthropic's margins rose from 38% to 70%+ as ARR grew from $9B to $44B+; effective agentic token costs (~$0.99/M for Opus 4.7) are far below sticker prices due to high cache hit rates and input-heavy workload ratios; margin expansion is structural because hardware and software compression together make it durable.

Evolution: Consistent; provides the most concrete unit economics in the thread.

McKinsey

Projects AI agents will mediate $3-5 trillion of global retail commerce by 2030; argues brands must adopt machine-readable API infrastructure or be bypassed by AI purchasing agents.

Evolution: Consistent.

OpenAI

Presents internal research showing agents enabling longer and more complex tasks across professional roles; internal data shows Codex at 99.8% of token output and 137x growth in non-developer individual use since August 2025.

Evolution: Consistent with public advocacy for agentic AI; June 25 paper is the first publication of specific internal usage statistics in this thread.

DeepMind / Google

Frames enterprise computer use as a natural extension of Gemini's existing capabilities; pairs capability expansion with defense-in-depth safety including adversarial training and confirmation gates for irreversible actions.

Evolution: Consistent; a direct competitor to OpenAI and Microsoft in enterprise agent infrastructure.

Microsoft

Simultaneously reported as pulling back on expensive AI agent deployments due to cost, and actively expanding Copilot in Excel with finance workflow capabilities and audit features.

Evolution: The cost-pullback was first reported in May 2026; the Excel Copilot expansion from June 25 remains an unresolved apparent contradiction within the same company.

Eric Schmidt (ex-Google CEO)

Strongly bullish on agentic AI as a near-term business opportunity; predicts all businesses will build competing agents, implicitly acknowledging future margin compression.

Evolution: Consistent; widely amplified across social platforms in the week of June 19-25.

Enterprises (Uber and others)

Reporting that AI agent deployments cost more than equivalent human workers, resulting in pullback from some agent subscriptions.

Evolution: Consistent counter-narrative; the SemiAnalysis finding that effective costs for optimized deployments are far below sticker prices creates an unresolved question about whether these enterprises are using actual blended costs in their calculations.

Tensions

  • Goldman Sachs and McKinsey project multi-trillion-dollar economic impact from agent adoption by 2030; Microsoft and Uber report that current agent deployments cost more than equivalent human workers. [1][15][3][8][9][10]
  • SemiAnalysis reports effective Opus 4.7 costs near $0.99/million tokens for optimized agentic workloads; enterprises citing cost as prohibitive appear to be using a different cost basis — whether sticker pricing or suboptimal deployment configurations is not specified in available reports. [6][8][9][10]
  • Microsoft is both pulling back on expensive AI agent deployments on cost grounds and simultaneously expanding Copilot in Excel with new finance workflow capabilities — the two positions may reflect different product lines or cost assumptions within the same company. [1][15][11][8]
  • OpenAI's research frames agents as broadly transformative across professional roles including legal and finance; the internal token data showing Codex at 99.8% of output suggests current value is concentrated in software development. [19][2]
  • SemiAnalysis argues AI labs now capture most value in the stack and that margin expansion is structural; the Goldman Sachs thesis implies cloud infrastructure providers will also benefit as demand grows — whether lab value capture comes at infrastructure providers' expense is unresolved. [4][5][1]

Sources

  1. [1] Goldman Sachs: "Token use by AI agents is expected to multiply 24 times by 2030" — Rohan Paul Twitter (2026-05-30)
  2. [2] OpenAI just released a paper showing how they are now seeing the first version of office work where agents do most of th… — Rohan Paul Twitter (2026-06-25)
  3. [3] Mckinsey report - AI agents are quietly taking over the retail shopping cart and could mediate $3 Tn to $5 tn of global … — Rohan Paul Twitter (2026-06-25)
  4. [4] If you are an operator trying to write down what tokens will cost in 2027, the answer is materially lower than today, an… — SemiAnalysis Twitter (2026-06-27)
  5. [5] The throughput math has gotten the most pushback in our reader notes, so its worth being precise. On the same B300 runni… — SemiAnalysis Twitter (2026-06-27)
  6. [6] The substitution math is the part to internalize. Tasks that used to need a junior analyst for several hours, converting… — SemiAnalysis Twitter (2026-06-27)
  7. [7] One of the more uncomfortable observations in our AI Value Capture piece is internal: our token spend at SemiAnalysis no… — SemiAnalysis Twitter (2026-06-27)
  8. [8] AI promised cost savings, but Microsoft and Uber say it’s costing more than human workers | Company Business News — reactive:ai-agent-economics-enterprise
  9. [9] Microsoft and Uber Pull Back on AI Subscriptions Due to Cost and ... — reactive:ai-agent-economics-enterprise
  10. [10] Uber, Microsoft, and Others Burning Through AI Budgets. Now What? — reactive:ai-agent-economics-enterprise
  11. [11] Microsoft just turned Copilot in Excel into a finance workflow system — Rohan Paul Twitter (2026-06-25)
  12. [12] Introducing computer use in Gemini 3.5 Flash — DeepMind Blog (2026-06-24)
  13. [13] Notion killing Skiff-influenced email app since most users use AI agents instead — Ars Technica AI (2026-06-25)
  14. [14] AI agents to automatically improve business-critical KPIs. — Rohan Paul Twitter (2026-06-29)
  15. [15] Goldman Sachs Research: "Token use by AI agents is expected to multiply 24 times by 2030" — Rohan Paul Twitter (2026-06-25)
  16. [16] Goldman Sachs Forecasts 24x AI Token Demand by 2030 — Enterprise DNA — reactive:ai-agent-economics-enterprise
  17. [17] Goldman Sachs: AI Agents Could Skyrocket Token Demand 24x — reactive:ai-agent-economics-enterprise
  18. [18] Goldman Sachs deciphers the AI agent economy: The decline in token costs will outpace price reductions, and cloud providers are approaching a turning point in gross margins. — reactive:ai-agent-economics-enterprise
  19. [19] How agents are transforming work — OpenAI Blog (2026-06-25)
  20. [20] OpenAI Replaces Custom GPTs With Workspace Agents Built for Team Workflows — reactive:ai-agent-economics-enterprise
  21. [21] AI Agents Set to Transform Workplaces in 2025, Says OpenAI CEO — reactive:ai-agent-economics-enterprise
  22. [22] "If you really want to make money, found an agentic AI company. — Rohan Paul Twitter (2026-06-25)
  23. [23] Eric Schmidt (ex-Google CEO): “if you really want to make money, it’s actually easy. found an agentic AI company” — reactive:ai-agent-economics-enterprise (2026-06-24)
  24. [24] Eric Schmidt, Ex Google CEO. — reactive:ai-agent-economics-enterprise
  25. [25] Ex-Google CEO Eric Schmidt says, “If you really want to make ... — reactive:ai-agent-economics-enterprise
  26. [26] Eric Schmidt: Build AI Agents, Get Rich - YouTube — reactive:ai-agent-economics-enterprise
  27. [27] RT @cyrilXBT: Eric Schmidt (ex-Google CEO): “if you really want to make money, it’s actually easy. found an agentic AI c... — reactive:ai-agent-economics-enterprise (2026-06-19)