$NVDA’s $20B Groq Bet: 256-Chip Rack, Samsung Production, $1T Target
Imagine a single server rack housing 256 specialized AI processors, all purpose-built to answer one question faster than any GPU ever could: how do you run AI inference at scale without the latency tax that general-purpose silicon inevitably imposes? That is the engineering premise Jensen Huang put on stage in San Jose on March 16, 2026, and the business premise behind it is even bolder — a reported ~$20 billion non-exclusive license deal that brought Groq’s Language Processing Unit (LPU) technology inside Nvidia’s architecture. Read more »