NVIDIA vs. Custom ASICs: GPU Dominance Persists Despite Startup Performance Claims
What
For roughly two years, market observers expected custom ASICs to erode NVIDIA's dominant share of AI compute. Mid-2026 data suggests the opposite has occurred — NVIDIA has held or grown its position [1], and NVIDIA's CEO projects continued rapid growth [2]. SemiAnalysis attributes this to software: NVIDIA's CUDA ecosystem is the actual moat, and 99% of chip startups fail because they underestimate software depth relative to hardware specs [3]. Against this backdrop, startup Tensordyne claims 13x the rack throughput of NVIDIA's NVL72 GB300 on DeepSeek-R1 — but the figure is based on internal simulations with no independent validation [4], following the pattern SemiAnalysis describes.
Why it matters
Whether NVIDIA's software moat is durable determines how much of AI compute infrastructure remains captured by a single vendor. Hyperscalers — Meta and Amazon — are building custom silicon with the engineering scale to co-develop supporting software stacks, which may be structurally different from independent startups [5][6]. If SemiAnalysis is right that AI chips are fundamentally a software problem, the barrier to unseating NVIDIA is higher than any hardware benchmark suggests.
Open questions
Will Tensordyne's 13x throughput claim survive independent testing, or dissolve into the pattern where simulated benchmarks don't transfer to production deployments? [4][3]
Meta and Amazon are expanding custom silicon with captive workloads and engineering scale — does this represent a durable alternative to NVIDIA in hyperscaler accounts, or primarily marginal displacement? [5][6]
What specific mechanism explains NVIDIA's market share resilience against ASICs — CUDA depth, supply chain positioning, ecosystem lock-in, or some combination? [1]
How does China's growing independence in AI supply chain components — including compound semiconductors and Huawei's architecture work — change the longer-term competitive calculus? [7]
Narrative
For roughly two years, the dominant prediction in semiconductor markets was that custom ASICs — designed by hyperscalers or by startups — would gradually absorb AI workloads from NVIDIA GPUs, compressing NVIDIA's market share. As of mid-2026, the data tell the opposite story: NVIDIA has held or grown its position against ASICs, reversing a widely held expectation [1]. NVIDIA's CEO has publicly projected that rapid growth will continue into the following year [2].
The explanation that has gained the most analytical traction centers on software rather than silicon. SemiAnalysis states directly that AI chip competition is fundamentally decided by software maturity: 100% of chip startups produce slides with simulated benchmark numbers showing outperformance, but 99% of custom ASIC projects fail — because building a chip and populating a slide is straightforward, while building the surrounding software ecosystem is not [3]. NVIDIA's CUDA platform, accumulated over roughly two decades, functions as the principal barrier to displacement.
This pattern is on display in the latest benchmark cycle. Tensordyne, a new inference hardware company, published a claim of 13x rack throughput versus NVIDIA's NVL72 GB300 on DeepSeek-R1 workloads [4]. The caveat is significant: the figures are based on internal simulations, not third-party or independent testing. Rohan Paul, who covered the announcement, called it a 'massive breakthrough' while acknowledging the simulation basis [4]. No independent validation has appeared.
Hyperscalers present a structurally distinct case. Meta announced an expansion of its MTIA custom silicon to power AI workloads [5], and Amazon is entering the AI chip market [6]. Unlike independent startups, large cloud providers have the engineering scale and captive, predictable workloads to develop the software stacks necessary to make custom silicon viable. The degree to which this displaces NVIDIA in hyperscaler accounts — versus shifting only specific, well-understood inference tasks — remains an open question. China's domestic AI supply chain development, including positions in compound semiconductors and Huawei's architecture work, adds a separate competitive variable operating outside the NVIDIA-versus-startup frame [7].
Timeline
- 2026-03: Meta announces expansion of its MTIA custom silicon program to power next-generation AI workloads. [5]
- 2026-06-14: NVIDIA CEO Jensen Huang states publicly that next year's growth will remain rapid. [2]
- 2026-06-15: Analysis published on China's growing supply chain independence in AI hardware, covering compound semiconductors and Huawei's logic-folding architecture. [7]
- 2026-06-17: Tensordyne announces an inference rack claiming 13x rack throughput versus NVIDIA's NVL72 GB300 on DeepSeek-R1, based on internal simulations. [4][8]
- 2026-06-18: Milk Road AI publishes a thread arguing data shows NVIDIA has held or grown market share against ASICs, contrary to the two-year conventional prediction. [1]
- 2026-06-19: Amazon reported to be entering the AI chip market. [6]
- 2026-06-19: SemiAnalysis states that 99% of custom ASIC projects fail and that AI chip success is determined by software depth, not hardware specifications. [3]
Perspectives
SemiAnalysis
AI chip competition is decided by software ecosystem depth, not hardware benchmarks. Every startup shows impressive simulated numbers on slides; 99% still fail because building a competitive software stack is the actual hard problem.
Evolution: Consistent and direct skeptic of the hardware-first ASIC narrative.
Milk Road AI
Data as of mid-2026 shows NVIDIA has held or grown market share against ASICs, directly reversing the two-year consensus prediction.
Evolution: Contrarian framing consistent with emerging market share data.
Tensordyne
Claims its inference rack achieves 13x the throughput of NVIDIA's NVL72 GB300 on DeepSeek-R1 based on internal simulations; positions itself as a meaningful challenger in the inference market.
Evolution: New entrant with no prior public stance on record.
Rohan Paul
Positive framing on Tensordyne's announcement, characterizing it as a 'massive breakthrough,' while noting the simulation caveat and absence of independent validation.
Evolution: Consistent tech-optimist coverage with stated caveats.
NVIDIA / Jensen Huang
Projects continued rapid growth into the following year; positions GPU platform as the durable foundation for AI compute infrastructure.
Evolution: Consistently bullish; market share data in mid-2026 supports the claim.
Meta
Treating custom silicon (MTIA) as critical to scaling next-generation AI; expanding internal chip program as a supplement or partial replacement for external GPU procurement.
Evolution: Deepening commitment to custom silicon through 2026.
Sky Rain
China's positions in compound semiconductors and Huawei's architecture work are building a supply chain track that operates outside the NVIDIA-dominated ecosystem.
Evolution: Consistent focus on China supply chain independence as a distinct competitive thread.
Tensions
- SemiAnalysis argues ASIC startup performance claims are essentially marketing noise — 99% of projects fail regardless of benchmark slides — while Tensordyne and its promoters treat a 13x simulation result as a meaningful breakthrough. [3][4]
- Milk Road AI argues data shows NVIDIA has held or grown share against ASICs, directly contradicting the two-year consensus prediction that custom silicon would erode NVIDIA's position. [1]
- The software moat argument (SemiAnalysis) holds that startups cannot overcome CUDA's depth; Meta and Amazon's hyperscaler buildout tests whether organizations with sufficient scale can develop the required software stack alongside custom hardware. [3][5][6]
- Tensordyne's 13x throughput claim remains unverified by any third party; the gap between the company's simulation-based number and any independent result is unresolved. [4][8]
Status: active and growing
Sources
- [1] Everyone assumed Nvidia would get crushed by ASICs but the data says the opposite just happened and the reason why chang… — Milk Road AI Twitter (2026-06-18)
- [2] 🚨 $NVDA -NVIDIA CEO JENSEN HUANG: NEXT YEAR’S GROWTH WILL REMAIN RAPID 🚀🧠 — reactive:asic-gpu-market-dynamics (2026-06-14)
- [3] 100% of AI chip startups have slides/“simulated performance data” showing that their chip is way better, but 99% of cust… — SemiAnalysis Twitter (2026-06-19)
- [4] Quite a massive inferencing rack breakthrough from @TensordyneInc . — Rohan Paul Twitter (2026-06-17)
- [5] Expanding Meta's Custom Silicon to Power Our AI Workloads — reactive:asic-gpu-market-dynamics
- [6] 🚨 AMAZON IS ENTERING THE AI CHIP MARKET — reactive:asic-gpu-market-dynamics (2026-06-19)
- [7] China’s Quiet Dominance in the AI Supply Chain: InP, Semiconductor Independence, and Huawei’s Logic Folding Wildcard — reactive:asic-gpu-market-dynamics (2026-06-15)
- [8] Tensordyne Announces Breakthrough Inference System - LinkedIn — reactive:asic-gpu-market-dynamics
- [9] Meta's Custom Silicon Accelerates Next-Gen AI with MTIA Evolution | AI at Meta posted on the topic | LinkedIn — reactive:asic-gpu-market-dynamics