The Information Machine

NVIDIA vs. Custom ASICs: GPU Dominance Persists Despite Startup Performance Claims · history

Version 2

2026-06-21 02:19 UTC · 41 items

What

NVIDIA has held or grown AI compute market share against custom ASICs as of mid-2026, reversing two years of predictions that custom silicon would erode NVIDIA's position [1]. A development from mid-June complicates the simple competitive framing: NVIDIA's NVLink Fusion technology allows hyperscalers to integrate non-NVIDIA silicon into NVIDIA-led clusters, positioning custom chip makers like Marvell as ecosystem participants rather than pure competitors [4][5]. Jensen Huang personally appeared at a Marvell keynote to make this point, and projects continued rapid growth [2][4]. Meanwhile, startups Tensordyne and DeepAdapt have each published large performance claims — 13x throughput [6] and 82% cost reduction with 33x faster inference [7] respectively — both based on unverified internal figures.

Why it matters

If custom silicon increasingly operates within NVIDIA's interconnect infrastructure via NVLink Fusion rather than replacing it, NVIDIA retains value from the growth of custom chips rather than losing share to them. The question for the competitive landscape shifts from whether ASICs displace NVIDIA to which parts of the AI compute stack NVIDIA continues to control.

Open questions

  • Does NVLink Fusion establish NVIDIA's interconnect layer as mandatory infrastructure even as custom compute silicon grows — meaning NVIDIA benefits from, rather than loses to, the ASIC buildout? [4]

  • Will Tensordyne's 13x throughput claim or DeepAdapt's 82% cost reduction survive independent testing, given that both rest on unverified internal benchmarks? [6][7]

  • Meta and Amazon are expanding custom silicon with captive workloads and engineering scale — will their chips remain within NVIDIA's NVLink Fusion ecosystem or provide a path to eventual independence? [8][9][4]

  • What specific mechanism explains NVIDIA's market share resilience — CUDA depth, supply chain positioning, NVLink Fusion lock-in, or some combination? [1][3]

Narrative

For roughly two years, the dominant expectation in AI compute markets was that custom ASICs — built by hyperscalers and startups alike — would gradually absorb workloads from NVIDIA GPUs. Mid-2026 data has not confirmed that prediction: NVIDIA has held or grown its market share against ASICs [1], and Jensen Huang has publicly projected continued rapid growth into the following year [2]. The analytical explanation that has gained the most traction centers on software rather than silicon. SemiAnalysis states directly that AI chip competition is decided by software ecosystem depth: 100% of chip startups publish slides with impressive simulated benchmark numbers, but 99% fail in production because building a competitive software stack alongside the chip is the actual hard problem — one that NVIDIA's CUDA platform, accumulated over roughly two decades, has largely solved [3].

A mid-June development reframes the competitive picture in a significant way. NVIDIA's NVLink Fusion technology allows large hyperscalers — including Amazon — to integrate non-NVIDIA silicon into NVIDIA-led clusters, enabling coexistence rather than replacement [4]. Jensen Huang personally appeared at a Marvell keynote to explain connectivity's role in AI systems, a concrete signal that NVIDIA positions custom silicon makers as participants within its ecosystem rather than purely external competitors [4]. Marvell itself illustrates who occupies this ecosystem role: the company spent roughly $36 billion on acquisitions over the past decade, transforming from a consumer chip maker whose largest 2016 design win was a Wi-Fi chip in a children's toy into a major AI semiconductor supplier [5]. Under the NVLink Fusion model, the competitive framing of 'NVIDIA versus everyone' gives way to a picture where custom silicon plugs into NVIDIA's interconnect backbone.

The startup benchmark cycle continues alongside these structural developments. Tensordyne published a claim of 13x rack throughput versus NVIDIA's NVL72 GB300 on DeepSeek-R1 workloads, based on internal simulations with no independent validation [6]. DeepAdapt separately claims its runtime intelligence layer cuts AI operating costs by 82% and delivers 33x faster inference by shifting repetitive workloads from GPUs to standard CPUs [7] — also without third-party verification. Both announcements fit the pattern SemiAnalysis describes: large numbers on slides, simulation basis, no external confirmation [3].

Hyperscalers remain a structurally distinct case. Meta has expanded its MTIA custom silicon program to power next-generation AI workloads [8], and Amazon is entering the AI chip market [9]. Unlike independent startups, these organizations have the engineering scale and captive, predictable workloads to develop supporting software stacks alongside custom hardware. Whether their chips operate within the NVLink Fusion ecosystem or eventually provide a path to independence from NVIDIA is an open question. China's domestic AI supply chain development — covering compound semiconductors and Huawei's architecture work [10] — operates outside this ecosystem frame entirely, as a separate competitive track.

Timeline

  • 2026-03: Meta announces expansion of its MTIA custom silicon program to power next-generation AI workloads. [8]
  • 2026-06-14: NVIDIA CEO Jensen Huang states publicly that next year's growth will remain rapid. [2]
  • 2026-06-15: Analysis published on China's growing supply chain independence in AI hardware, covering compound semiconductors and Huawei's architecture work. [10]
  • 2026-06-17: Tensordyne announces an inference rack claiming 13x rack throughput versus NVIDIA's NVL72 GB300 on DeepSeek-R1, based on internal simulations. [6][12]
  • 2026-06-18: Milk Road AI publishes analysis arguing data shows NVIDIA has held or grown market share against ASICs, contrary to two years of consensus predictions. [1]
  • 2026-06-19: Jensen Huang appears at a Marvell keynote to explain connectivity's role in AI systems, framing NVLink Fusion as enabling custom silicon coexistence within NVIDIA-led clusters. [4]
  • 2026-06-19: Amazon reported to be entering the AI chip market. [9]
  • 2026-06-19: SemiAnalysis states that 99% of custom ASIC projects fail and that AI chip success is determined by software depth, not hardware specifications. [3]
  • 2026-06-19: DeepAdapt claims its runtime layer cuts AI operating costs by 82% and delivers 33x faster inference by shifting workloads from GPUs to CPUs, without independent validation. [7]
  • 2026-06-20: Milk Road AI highlights Marvell's transformation from consumer chip maker to major AI semiconductor supplier via $36 billion in acquisitions over a decade. [5]
  • 2026-06-20: SemiAnalysis argues AI networking's copper-vs-optics binary framing oversimplifies the actual landscape and advocates for a GPU cluster architecture lens. [11]

Perspectives

NVIDIA / Jensen Huang

Projects continued rapid growth; NVLink Fusion positions custom silicon makers as ecosystem participants rather than competitors, reframing NVIDIA's role as the interconnect backbone of AI compute.

Evolution: Consistently bullish on growth; the NVLink Fusion strategy represents a more explicit embrace of coexistence with custom silicon than prior positioning.

SemiAnalysis

AI chip competition is decided by software ecosystem depth, not hardware benchmarks; 99% of ASIC projects fail in production regardless of simulation results. Also argues AI networking copper-vs-optics binary is an oversimplification.

Evolution: Consistent skeptic of hardware-first ASIC narratives; extended the analysis to networking investment framing.

Milk Road AI

Data shows NVIDIA has held or grown market share against ASICs; separately argues the 'NVIDIA versus everyone' competitive frame is wrong and that NVLink Fusion makes custom silicon makers like Marvell ecosystem participants.

Evolution: Contrarian on ASIC displacement; now explicitly reframes competition as coexistence via NVLink Fusion.

Marvell

Has positioned itself as a major AI semiconductor supplier — building custom ASICs for hyperscalers — that operates within NVIDIA's connectivity ecosystem rather than against it.

Evolution: New voice in this thread; Jensen Huang's appearance at its keynote signals mutual recognition of the complementary relationship.

Meta

Treating custom silicon (MTIA) as critical to scaling next-generation AI; expanding internal chip program as a supplement or partial replacement for external GPU procurement.

Evolution: Deepening commitment to custom silicon through 2026.

Tensordyne / DeepAdapt

Both claim large performance advantages over NVIDIA-centric inference (13x throughput and 82% cost reduction respectively), based on internal simulations without independent validation.

Evolution: New entrants following the benchmark-slide pattern SemiAnalysis describes.

Rohan Paul

Covers startup announcements (Tensordyne, DeepAdapt) with positive framing and large headline numbers while noting simulation caveats.

Evolution: Consistent tech-optimist coverage with stated caveats on verification.

Sky Rain

China's positions in compound semiconductors and Huawei's architecture work are building a supply chain track that operates outside the NVIDIA-dominated ecosystem.

Evolution: Consistent focus on China supply chain independence as a structurally distinct competitive thread.

Tensions

  • Milk Road AI and NVIDIA argue the 'NVIDIA versus everyone' frame is wrong — NVLink Fusion makes custom silicon a coexistent participant; SemiAnalysis and prior market share data support NVIDIA's resilience but through a different mechanism (software moat, not ecosystem embrace). [4][1][3]
  • SemiAnalysis argues ASIC startup performance claims are essentially marketing noise — 99% of projects fail regardless of benchmark slides — while Tensordyne and DeepAdapt both publish large unverified numbers framed as breakthroughs. [3][6][7]
  • Milk Road AI argues mid-2026 data shows NVIDIA holding or growing market share, directly contradicting the two-year consensus prediction that custom silicon would erode NVIDIA's position. [1]
  • The software moat argument holds that startups cannot overcome CUDA's depth; Meta and Amazon's hyperscaler buildout — with captive workloads and engineering scale — tests whether organizations with sufficient resources can develop the required software stack alongside custom hardware. [3][8][9]
  • Tensordyne's 13x throughput claim and DeepAdapt's 82% cost reduction both remain unverified by any third party; the gap between simulation-based numbers and any independent result is unresolved. [6][7]

Sources

  1. [1] Everyone assumed Nvidia would get crushed by ASICs but the data says the opposite just happened and the reason why chang… — Milk Road AI Twitter (2026-06-18)
  2. [2] 🚨 $NVDA -NVIDIA CEO JENSEN HUANG: NEXT YEAR’S GROWTH WILL REMAIN RAPID 🚀🧠 — reactive:asic-gpu-market-dynamics (2026-06-14)
  3. [3] 100% of AI chip startups have slides/“simulated performance data” showing that their chip is way better, but 99% of cust… — SemiAnalysis Twitter (2026-06-19)
  4. [4] Jensen Huang showed up at a Marvell keynote to explain why connectivity matters (Save this). — Milk Road AI Twitter (2026-06-19)
  5. [5] In 2016, Marvell's largest design win was a Wi-Fi chip in the Barbie Dream House (Save this). — Milk Road AI Twitter (2026-06-20)
  6. [6] Quite a massive inferencing rack breakthrough from @TensordyneInc . — Rohan Paul Twitter (2026-06-17)
  7. [7] DeepAdapt has launched a runtime intelligence layer that cuts AI operating costs by up to 82% and 33X faster inference b… — Rohan Paul Twitter (2026-06-19)
  8. [8] Expanding Meta's Custom Silicon to Power Our AI Workloads — reactive:asic-gpu-market-dynamics
  9. [9] 🚨 AMAZON IS ENTERING THE AI CHIP MARKET — reactive:asic-gpu-market-dynamics (2026-06-19)
  10. [10] China’s Quiet Dominance in the AI Supply Chain: InP, Semiconductor Independence, and Huawei’s Logic Folding Wildcard — reactive:asic-gpu-market-dynamics (2026-06-15)
  11. [11] Investors have increasingly framed AI networking as a binary debate between copper and optics. Thus they are constantly … — SemiAnalysis Twitter (2026-06-20)
  12. [12] Tensordyne Announces Breakthrough Inference System - LinkedIn — reactive:asic-gpu-market-dynamics