WebpronewsAI & LLMs

Memory and Power: The Two Constraints Reshaping AI Infrastructure

Earnings calls from Apple, AMD, and Intel last quarter laid bare a familiar problem with a new twist: memory shortages are back, but this time they're driven by AI data centers consuming not just electricity but the same DRAM and NAND components found in consumer devices. The result is a bifurcated market where high-margin AI hardware gets priority, and budget laptops, phones, and game consoles face price hikes or outright discontinuation.

From a systems perspective, the core issue is fab allocation. Foundries prioritize high-bandwidth memory (HBM) and DDR5 for AI accelerators over DDR4 for consumer gear. DRAM spot prices for certain densities jumped 75% between December and January. TrendForce projects mainstream laptop prices rising 40% in 2026. Microsoft raised Surface prices by £170–£200 and dropped cheaper SKUs. Apple bumped MacBook Air base pricing by £100 and doubled minimum storage. Sony added £90 to the PS5. These aren't margin grabs—they're cost pass-throughs on components that now represent 23–30% of bill of materials for entry-level devices. Gartner predicts the sub-$500 PC segment disappears by 2028.

The power side compounds the problem. U.S. data centers consumed 176 TWh in 2023 (4.4% of national electricity). Lawrence Berkeley National Lab projects 325–580 TWh by 2028—up to 12% of total U.S. usage. Morgan Stanley estimates 74 GW of data-center demand by 2028 against a 49 GW power-access shortfall. PJM capacity prices spiked twelvefold to $333 per megawatt-day. Half of planned 2026 U.S. data-center builds face delays or cancellation, not from capital constraints—big tech plans $650 billion in AI infrastructure this year—but from transformer lead times stretching five years and grid interconnection queues.

Power availability now dictates site selection. Gartner predicts shortages will constrain 40% of AI data centers by 2027. Microsoft signed a 20-year deal to restart Three Mile Island Unit 1. Amazon secured nearly 2 GW of nuclear access. Google partners with Kairos Power on small modular reactors. Meta seeks 4 GW of new nuclear supply. The White House issued four executive orders in one day to speed nuclear deployment. Nuclear offers the only realistic baseload match for always-on AI racks; renewables are intermittent, and gas plants take years to site.

The bottleneck has flipped from silicon to infrastructure. Memory makers Samsung, SK Hynix, and Micron sold out high-end capacity through 2026. SK Hynix sees the squeeze lasting until 2030. New fabs won't ramp until 2027 at the earliest. Meanwhile, utilities hike rates, factories face curtailment risks, and national competitiveness hinges on who secures electrons first. OpenAI warned the White House of an 'electron gap' that could erode U.S. AI leadership. The material constraints are no longer theoretical—they're embedded in every supply agreement, power purchase deal, and product roadmap.

Source: Webpronews

← Back to News