Picture an AI data center where every GPU rack is bottlenecked not by training compute, but by the speed at which a model can generate the next token — the “decode” phase that determines whether an agentic AI assistant feels instant or glacial. That is the exact gap Nvidia used as its opening argument at GTC 2026, and the answer it brought to the stage was the Groq 3 LPX. Built on LPU (Language Processing Unit, a chip architecture purpose-built for low-latency sequential decode rather than parallel matrix math) technology acquired through a $17–$20B deal, and manufactured by Samsung, the new rack system is Nvidia’s most aggressive move yet into the inference market it has long treated as a secondary concern. Read more »