Version 11

NVIDIA reportedly holds approximately 92% of the GPU market [2] while Jensen Huang publicly characterized competitor custom ASICs as 'science projects' compared to NVIDIA's AI factory platform [10]. Etched exited stealth with $800M raised, over $1B in customer contracts, and 400+ engineers recruited from NVIDIA, TSMC, and other semiconductor companies [13][14], claiming 10x inference improvement over incumbents via a cluster-scale memory architecture [15][16] — with no independent benchmarks published. OpenAI's Jalapeño inference chip, built in nine months with Broadcom, targets gigawatt-scale deployment with Microsoft starting in 2026 [19][21], also without external validation. The central question is whether CUDA's software depth — illustrated by a 2.5x serving cost reduction in under 70 days [4] — is a structural advantage custom silicon challengers cannot close.

Etched's launch with substantial funding, customer commitments, and deep industry talent, alongside OpenAI's Jalapeño deployment, provide two structurally distinct tests of whether custom inference silicon can challenge NVIDIA's software moat in production: a hardware-first startup and a hyperscaler with captive workloads. Whether either converts benchmark claims into verified production results will determine whether the software moat thesis holds.

NVIDIA has held or grown AI compute market share against custom ASICs through mid-2026 [1], reportedly commanding approximately 92% of the GPU market [2]. The analytical explanation with the most traction centers on software: SemiAnalysis argues that AI chip competition is decided by software ecosystem depth, not hardware benchmarks, and that 99% of custom ASIC projects fail in production because building a competitive software stack is the actual hard problem — one NVIDIA has largely solved over two decades [3]. A concrete data point: serving costs on NVIDIA's GB200 NVL72 dropped 2.5x in under 70 days through CUDA kernel rewrites applied to the Kimi model architecture [4], illustrating software-layer improvement that hardware-first competitors cannot replicate on short timelines. NVIDIA has simultaneously structured custom silicon as a participant in its own ecosystem via NVLink Fusion, spanning Marvell and SiFive (chip designers), Samsung Foundry (manufacturing), Astera Labs (connectivity), and MediaTek [5][6][7][8][9].

Jensen Huang made his sharpest public statement on competition in early July 2026, characterizing competitor custom ASICs as 'science projects' compared to NVIDIA's AI factory platform, adding that competitors are still copying NVIDIA's previous generation while its roadmap is at the physical limits of semiconductor scaling, and that NVIDIA is 'the only platform to build on' when betting hundreds of billions on AI infrastructure [10]. This framing directly responds to a wave of challenger claims: Tensordyne announced 13x rack throughput versus NVIDIA's NVL72 GB300 on DeepSeek-R1 [11], and DeepAdapt claimed 82% AI operating cost reduction by shifting GPU workloads to CPUs [12] — both based on internal simulations without independent validation, fitting the pattern SemiAnalysis describes.

Etched exited stealth on June 30, 2026 with $800M raised, over $1B in customer contracts, and a team of 400+ engineers recruited from NVIDIA, TSMC, and other leading semiconductor companies [13][14]. The company claims 10x inference improvement over incumbent chipmakers via a cluster-scale memory (CSM) architecture that creates a shared low-latency memory pool across an entire scale-up domain, combining HBM and SRAM to target both throughput and interactive inference speeds [15][16]. Andrej Karpathy publicly praised the approach's extreme low-voltage engineering targeting tokens-per-watt at interactive speeds [17]; SemiAnalysis noted the design's high SerDes count [18] without assessing production viability. No independent benchmarks have been published. OpenAI and Broadcom announced Jalapeño on June 24 — OpenAI's first custom LLM inference chip, built in nine months — claiming better performance per watt and lower serving costs, targeting gigawatt-scale deployment with Microsoft starting in 2026 [19][20][21]. SemiAnalysis noted the nine-month timeline requires 'making no mistakes' [22].

The structural argument distinguishing hyperscalers from startups runs as follows: Meta expanding its MTIA silicon program [23] and Amazon entering the AI chip market [24] bring captive workloads and engineering depth that most hardware-first startups lack — the same workload ownership SemiAnalysis identifies as the key variable determining whether custom silicon can develop a competitive software stack. OpenAI brings that same structural advantage with Jalapeño. Etched's $1B+ in customer contracts and deep industry talent [13][14] represent the strongest version of the startup counterargument, but production performance rather than funding or headcount will determine whether the software moat thesis holds.