Nvidia just introduced the Groq 3 LPU, its first inference chip born out of a $20 billion technology deal with startup Groq. Built into Groq 3 LPX racks alongside Vera Rubin GPUs, it delivers up to 1,500 tokens per second and 35 times higher throughput per megawatt to keep multi-agent systems talking without delay.
Groq just signed a non-exclusive licensing deal with Nvidia to scale its low-latency AI inference technology worldwide. Groq founder Jonathan Ross and president Sunny Madra are joining Nvidia to lead the integration, while Groq will remain an independent company led by new CEO Simon Edwards, keeping GroqCloud running uninterrupted.
Groq just officially became a supported Inference Provider on the Hugging Face Hub. Developers can now run open-source models like Llama 4 directly through Groq's low-latency LPU chips using HF's web UI or Python and JS SDKs. You can bill through Hugging Face without added markups or plug in your own Groq API key.
AI phone support startup Phonely just teamed up with Maitai and chipmaker Groq to slash voice bot response times by over 70%, pushing time-to-first-token down to 176 milliseconds. The system hit 99.2% accuracy across iterations, and over 70% of callers now can't tell it's a machine—prompting one client to swap out 350 human agents this month.
Groq just partnered with PlayAI to deploy its Dialog text-to-speech model on GroqCloud, featuring English and native Arabic support. Using PlayAI's adaptive contextualizer alongside Groq's LPUs, the model responds with conversation-aware emotion at up to 140 characters per second—roughly 10x faster than real time. Why it matters: developers can now build voice agents with near-zero latency and convincing prosody directly on a single inference platform.
Groq just opened its Developer Tier to everyone with no waitlist or prerequisites. Developers get higher rate limits, global billing support, and flex and batch processing options. It removes the scaling bottleneck for teams building real-time AI apps on fast LPU inference.
Groq just partnered with Saudi oil giant Aramco to build a massive AI inference data center in Saudi Arabia. Funded by Aramco with a nine-figure budget, the site will launch by the end of this year with 19,000 LPUs and could scale to 200,000 units. Why it matters: Low energy costs and strategic location could make the Gulf a vital AI compute hub for surrounding regions.
AI chip startup Groq just pulled in a massive $640 million funding round led by Blackrock, valuing the inference specialist at $2.8 billion. The company claims its custom LPUs run generative AI models 10x faster and with a fraction of the energy of conventional GPUs. Meta's Yann LeCun is also joining as a technical advisor, giving the upstart serious ammo against Nvidia.
AI chipmaker Groq just acquired analytics startup Definitive Intelligence for an undisclosed sum to scale its on-demand platform, GroqCloud. Definitive Intelligence previously helped build the cloud infrastructure, which lets developers access Groq's ultrafast LPUs on demand. Its CEO Sunny Madra will now take charge of GroqCloud, alongside a new Groq Systems division targeting government and enterprise deployments.
Groq just went viral with an AI chip architecture that makes standard cloud GPUs look sluggish. Powered by custom Language Processing Units (LPUs), independent benchmarks clocked Groq hitting 247 tokens per second—over 13 times faster than Microsoft’s cloud baseline. Why it matters: this raw speed bypasses memory bottlenecks, finally making lag-free, real-time voice conversations with AI viable.
