The AI Bullwhip

The popular narrative of AI infrastructure is a tidy relay race : first GPUs were scarce, then memory choked throughput, then CPUs took the strain, & finally storage started to bite.

The pricing data says the relay is real but slow. Some components plunged before they surged. Each bottleneck freezes the next component’s supply chain, but the lag runs in years, & every wave locks in a higher baseline cost.

The initial shock in early 2023 belonged to the GPU. When ChatGPT launched, buyers concentrated capital on procuring GPUs, sending on-demand Nvidia H100 rental rates past $9 an hour.¹

That monomania starved conventional computing. Server unit shipments fell 22% in 2023 to below 2018 levels as buyers deferred refresh cycles to fund GPUs.² Memory makers, already reeling from a post-pandemic glut that cost the industry more than $20b & forced wafer cuts of up to 40%, lost the server demand that would have absorbed their inventory.³

Eighteen months later, the pressure migrated to memory. To escape that slump & chase AI margins, manufacturers converted cleanrooms & lithography tools toward High Bandwidth Memory (HBM).

HBM consumes roughly three times the wafer capacity per gigabyte of standard DDR5, so every bit of HBM output removes about three bits of conventional supply. Enterprise solid state drive (SSD) contract prices rose 80% in a single quarter, while Micron reported dynamic random-access memory (DRAM) prices climbing in the low-60s percentage range quarter over quarter.⁴

By late 2025, agents squeezed server CPUs. Training clusters ran one central processing unit (CPU) to eight GPUs. Agentic workflows invert that : autonomous systems spend their cycles compiling code, calling tools, & managing state, pushing the ratio toward 1:1.⁵ Intel reported server CPU average selling prices (ASPs) rose 27% year over year against falling unit volumes, citing billions in unmet Xeon demand.⁶

By 2026, the shortage reached bulk storage. Priced out of high-speed flash at $150 per terabyte, cloud architects retreated down the technology ladder into traditional, slower hard disk drives (HDDs) for bulk training data lakes. Western Digital & Seagate confirmed their entire 2026 nearline production is sold out.⁷

Beyond the server chassis, the story is unambiguous. The fastest-rising cost is the data center’s concrete floor & the reinforced walls.

Data centers now cost upwards of $20b per gigawatt ($20b/GW), with electrical systems consuming half the budget.⁸ Construction costs have tripled to $1,033 per square foot, ⁹ excluding land. Outside, generator step-up (GSU) transformers average nearly three year lead times, while GE Vernova & Siemens Energy have sold out turbine production through 2029, with order books stretching to 2031.¹⁰

As Barry Powell of Siemens observed of the double bind :

“You’re damned if you do, damned if you don’t: If you don’t build enough, then you’re going to get dinged for losing some market share. And if you build too much, you’re going to get dinged for fixed costs. We understand at some point there could be a bubble and we’re racing to pay back the investments as quickly as possible.”¹¹

This is the Bullwhip Effect in physical hardware.¹² When a value chain suffers from multi-year manufacturing latency, sudden demand shocks downstream amplify into massive, lagged overreactions upstream. Relieving pressure at one bottleneck pushes it into the next component with a predictable delay. When the wave finally breaks, long-lead-time capital goods are the ones left exposed to overcapacity.

Over $2b in domestic transformer expansions, next-generation 300-layer NAND fabs, & new turbine production lines will deliver in 2027 & 2028. If end-user software revenues do not keep pace with $20b per gigawatt facilities, capital expenditure will face a classic crack of the whip.