Agentic inference capacity grew 4.6× in a year, versus 2.6× for compute capacity
What happened
Epoch AI estimates that the AI chips sold so far could handle 4.6 times more long-running agent-style work in Q2 2026 than in Q2 2025, while raw computing power rose only 2.6 times. Nvidia's chips account for 74% of the added capability.
Why it matters
If you buy AI agent services, capacity is outgrowing raw computing power, which gives you grounds to push providers on price.
Ask your team
Are we renegotiating what we pay for AI agent workloads, now that supply is growing faster than raw chip power?
Seventy’s view
Ask AI vendors at renewal how this capacity gain reaches your price; Nvidia's Blackwell drives most of it.
Connecting the dots
- Before
- Epoch AI built an Inference Performance Index that scores chips on long, cached agent workloads, then applied it to its dataset of AI chip sales.
- Next
- Watch whether Epoch AI's next update keeps agent capacity growing faster than raw compute.
Tap an underlined word to see what it means.
Read the original at Epoch AI
Something wrong in this story? Report a mistake. We check it against the source within 24 hours.
Share with your take
Start from our line and make it yours. It stays on your device until you post it.
Ask about this story
Answered only from this story, with the line it came from.