@Asianometry & Dylan Patel — How the semiconductor industry actually works

The conversation covers multiple interconnected topics in semiconductors and AI infrastructure. Dylan and John begin by discussing how talent flows drive technological progress in semiconductors, using historical examples like Richard Chang and Lee Naongsung who transferred expertise from TSMC to Samsung and SMIC respectively. They explain that semiconductor manufacturing is deeply compartmentalized with apprentice-master knowledge transfer systems, particularly in Taiwan through universities like NTU and National Chinghua.

The hosts analyze China's path to competing in AI, noting that despite export controls on chips, China could theoretically centralize compute resources and build massive data centers. They calculate that with current sanctions allowing over a million H20 GPUs annually, plus domestic chips like Huawei's Ascend 910B, China could construct a 1.3 trillion parameter model by 2026 if it chooses centralization. The key bottleneck is not chips but centralized decision-making—something the US avoids through distributed innovation across OpenAI, Anthropic, Google, and Meta.

On US AI infrastructure, they estimate that as of 2025, clusters of 300,000-500,000 GPUs are being built across multiple sites, equivalent to roughly 1 million H100s. By 2026-2027, gigawatt-scale data centers will emerge, with Microsoft, OpenAI, and others signing $100+ billion in fiber deals to connect regional data centers. They project that by 2028-2029, single-site or loosely-coupled multi-site clusters could reach millions of chips—potentially supporting training runs for 1.3 trillion parameter models.

The economics discussion reveals that GPU costs dominate total cost of ownership (80%), while power represents only 10%, contradicting the narrative that power availability limits data center buildout. The real constraint is the industrial capacity to deliver substations, transformers, and power generation infrastructure. China has massive advantages here due to continuous renewable energy and manufacturing buildouts.

On chip manufacturing bottlenecks, SMIC's Shanghai fab has ~25,000-35,000 wafers per month of leading-edge capacity despite possessing 45-50 immersion lithography tools, limited by yields and lack of EUV technology. Yet SMIC still produces millions of usable chips annually for Huawei phones and accelerators. The hosts argue export controls are somewhat effective but face fundamental limits—restricting one jigsaw puzzle piece only accelerates China's development of alternatives.

Capital dynamics reveal that OpenAI is expected to raise $50-100 billion in 2025, enabling continued scaling. They argue this isn't purely speculative because the revenue lag between capex spending and returns is tolerable for companies like Microsoft (which views this as a strategic investment), and because GPT-4's actual training cost (~$500 million) generated billions in recurring revenue, validating the ROI logic for 5x larger models.

The hosts discuss architectural divergence: Chinese AI systems will optimize differently than US systems due to memory bandwidth and compute constraints from the H20, potentially leading to different model architectures (wider networks, different attention mechanisms) compared to US solutions optimized for Nvidia's H100/Blackwell. They also compare the semiconductor industry's extreme siloing—where no individual knows the whole stack—to AI development's more open innovation model, and discuss how AI tools could revolutionize semiconductor design by tackling massive optimization search spaces.

Finally, Dylan and John share their origin stories: John started Asianometry as a travel vlog in 2017, gradually pivoting to business history and semiconductors over three years with minimal viewership, eventually becoming a major educational channel. Dylan was a hobbyist who reverse-engineered Xbox hardware at age 8, spent a decade obsessively studying semiconductor supply chains online and at conferences, then began consulting in 2020, eventually building Semi Analysis into a firm with customers including hyperscalers, semiconductor companies, and hedge funds.