# Groq Licenses LPU Architecture to Nvidia in $20B Deal

> In a surprising twist, Nvidia is licensing technology from a smaller rival. It paid roughly $20 billion for Groq's LPU inference architecture, a chip design built for one job: generating tokens as fast as possible. The Groq 3 LPU reaches about 1,500 tokens per second, leaning on 500MB of on-chip SRAM and 150 terabytes per second of internal bandwidth. The trade-offs are deliberate. An LPU gives up trainability and vision work in exchange for raw memory bandwidth and blistering autoregressive generation, which is exactly the profile that agentic AI, with its long chains of tool calls and reasoning steps, is hungry for. Nvidia plans to pair the design with its Vera Rubin systems in five new rack configurations shown at GTC 2026. Groq founders Jonathan Ross and Sunny Madra are moving to Nvidia, though Groq continues independently under new leadership. The deal is a tell about where inference is heading: as agents multiply, the speed and cost of producing tokens, not just training bigger models, becomes the battleground.

_Section: [Daily AI Updates](https://www.wortins.com/daily-ai) · Source: Spheron · Published Thursday, July 16, 2026_

## Wortins' read

In a surprising twist, Nvidia is licensing technology from a smaller rival. It paid roughly $20 billion for Groq's LPU inference architecture, a chip design built for one job: generating tokens as fast as possible. The Groq 3 LPU reaches about 1,500 tokens per second, leaning on 500MB of on-chip SRAM and 150 terabytes per second of internal bandwidth. The trade-offs are deliberate. An LPU gives up trainability and vision work in exchange for raw memory bandwidth and blistering autoregressive generation, which is exactly the profile that agentic AI, with its long chains of tool calls and reasoning steps, is hungry for. Nvidia plans to pair the design with its Vera Rubin systems in five new rack configurations shown at GTC 2026. Groq founders Jonathan Ross and Sunny Madra are moving to Nvidia, though Groq continues independently under new leadership. The deal is a tell about where inference is heading: as agents multiply, the speed and cost of producing tokens, not just training bigger models, becomes the battleground.

## Source

[Read the full story at Spheron](https://www.spheron.network/blog/nvidia-groq-3-lpu-explained/)

## Related coverage

- [Meta enters the crowded AI coding battle with Muse Spark 1.1](https://www.wortins.com/story/meta-enters-the-crowded-ai-coding-battle-with-muse-spark-1-1-06b7448d) — [TechCrunch](https://techcrunch.com/2026/07/09/meta-enters-the-crowded-ai-coding-battle-with-muse-spark-1-1/)
- [Another contender just joined the arms race over AI in schools](https://www.wortins.com/story/another-contender-just-joined-the-arms-race-over-ai-in-schoo-39958f53) — [Chalkbeat](https://www.chalkbeat.org/2026/07/14/anthropic-launches-claude-for-teachers-as-ai-companies-battle-for-classrooms/)
- [Helsing Raises $1.8B Series E at $18B Valuation in Europe's Largest Defense-Tech Round](https://www.wortins.com/story/helsing-raises-1-8b-series-e-at-18b-valuation-in-europe-s-la-32ef801c) — [cnbc.com](https://www.cnbc.com/2026/07/13/helsing-fund-raise-defense-18-billion.html)
- [Unitree Robotics Files for $7B Shanghai IPO with GD01 Mecha Launch](https://www.wortins.com/story/unitree-robotics-files-for-7b-shanghai-ipo-with-gd01-mecha-l-6a7fe21f) — [thenextweb.com](https://thenextweb.com/news/unitree-gd01-mecha-humanoid-robot-ipo)
- [Meta just launched a new AI generator, Muse Image, and users are already pushing back over use of their photos](https://www.wortins.com/story/meta-just-launched-a-new-ai-generator-muse-image-and-users-a-f69ca1c9) — [TechCrunch](https://techcrunch.com/2026/07/07/meta-rolls-out-muse-a-new-ai-image-generator/)
- [Neocloud Together AI raises $800M, leaps to $8.3B valuation](https://www.wortins.com/story/neocloud-together-ai-raises-800m-leaps-to-8-3b-valuation-fd68cc47) — [TechCrunch](https://techcrunch.com/2026/07/01/neocloud-together-ai-raises-800m-leaps-to-8-3b-valuation/)

---

_Curated and written by [Wortins](https://www.wortins.com) — The daily AI briefing. Every story links to its original source; the "Wortins read" on each is our own original analysis. [About Wortins & our editorial approach](https://www.wortins.com/about)._