The Information Machine

And every next-gen win in inference is a datacenter win. CPO, copper backplanes, NVL scale-up domains, better pJ/bit, be…

SemiAnalysis Twitter · SemiAnalysis (@SemiAnalysis_) · 2026-06-10

SemiAnalysis concludes a four-part thread arguing that every next-generation inference hardware advance — co-packaged optics, copper backplanes, NVLink scale-up, and energy-efficiency gains — is a datacenter-exclusive advantage that laptop form factors cannot replicate.

Open original ↗

Appears in

Extraction

Topics: ai-inferencedatacenter-hardwareenergy-efficiencysilicon-photonics

Claims

  • Co-packaged optics, copper backplanes, NVLink scale-up domains, and per-bit/per-watt improvements all accrue to datacenter deployments, not consumer hardware.
  • Datacenter inference improves in cost efficiency over time like large-scale steel production, while laptop-based inference hits hard physical limits.
  • The economies of scale in inference hardware are fundamentally incompatible with laptop form factors.

Key quotes

And every next-gen win in inference is a datacenter win. CPO, copper backplanes, NVL scale-up domains, better pJ/bit, better perf/watt — none of that ships in a laptop chassis.
The steel mill gets cheaper per ton every year. The village furnace can only get so hot!