Meta signs deal for millions of Amazon AI chips

What changed

Meta finalized a deal to purchase millions of custom AI CPUs from Amazon. The hardware is targeted at agentic inference workloads rather than large-scale model training, which remains GPU-dominated. The move is a deliberate diversification away from sole reliance on Nvidia silicon for serving traffic.

Why it matters

For engineering teams running production LLM inference, this signals that the cost curve for agentic workloads is about to shift. Custom CPUs optimized for inference change the price-per-token math, especially for workloads dominated by short prompts, tool calls, and multi-step agent chains. Cloud providers will pass some of that savings down through new instance types and pricing tiers as competition for inference market share intensifies.

What to watch for

Watch for new AWS instance types built around the deal and pricing changes for Inferentia and Trainium families. On the architecture side, abstract your inference backend so model serving can move between CUDA GPUs, AWS custom silicon, and other accelerators without rewrites. Run the same agentic workload across at least two backends and track latency, throughput, and cost per resolved task. Treat hardware portability as a first-class infrastructure requirement.