Groq is getting its next LPU ready, and the big architectural change comes down to memory. The company is moving from SRAM to 3D-stacked DRAM so it can fit larger AI models. Groq also hasn’t been acquired. In late 2025, it signed a non-exclusive licensing deal with NVIDIA, reportedly worth about $20 billion, and remained independent. For anyone watching the hardware closely, the trade-off is pretty direct: less of the extreme bandwidth Groq’s current design is known for, a lot more memory capacity from DRAM.
On the current chip, Groq uses 500MB of SRAM, roughly 150TB/s of bandwidth, and 1.20 PFLOPs of FP8 per chip. Scale that to 256 chips and the total lands around 128GB and 640TB/s. DRAM changes the picture by giving Groq much more capacity to work with. And to clear up a point that’s easy to get wrong, NVIDIA did not buy Groq. It signed that late-2025 non-exclusive licensing deal, reportedly worth about $20 billion, and hired several key Groq people, including founder Jonathan Ross, while Groq continued operating independently.
What seems most likely is TSV-connected, HBM-style stacked DRAM, which would raise density and should also help with power efficiency. Beyond that, a lot is still unknown. Timing, implementation details, and what any of this means for customers haven’t been spelled out yet.
If you follow AI serving hardware, keep an eye on this one. Groq’s LPX racks are already part of NVIDIA’s Vera Rubin ecosystem, reportedly reached full production in August, delivered around 3,400 tokens per second with NVL72 servers, and now sit alongside GroqCloud and Groq’s role as an NVIDIA Cloud Partner.
There’s nothing to download yet. Still, expect the next developments to show up through Groq’s data center and cloud platforms as model sizes keep climbing.
Author: Emmanuel Bosque
{
"social": {
"email": "",
"facebook": "",
"twitter": "",
"linkedin": ""
},
"ja-JP": "",
"de-DE": "Emmanuel Bosque schreibt bei Softonic über Videospiele: Neuerscheinungen, Updates, die aus einem Spiel still und leise ein anderes machen, und eine Branche, die ihre Schritte selten vorher ankündigt. Er schreibt für die, die spielen wollen, nicht für die, die diskutieren wollen: was heute spielbar ist, auf welcher Plattform und ob der Download sich lohnt. Er gehört zum Redaktionsteam von Softonic und arbeitet täglich mit KI-Werkzeugen in der Produktion.",
"en-US": "Emmanuel Bosque covers video games at Softonic: releases, the updates that quietly turn a game into a different one, and an industry that rarely announces its moves in advance. He writes for the person who is going to play, not the person who is going to argue: what you can play today, on which platform, and whether it is worth the download. He is part of Softonic's editorial team and works daily with AI tools in content production.",
"es-ES": "Emmanuel Bosque cubre videojuegos en Softonic: lanzamientos, actualizaciones que convierten un juego en otro sin decirlo y los movimientos de una industria que casi nunca avisa. Escribe pensando en quien va a jugar, no en quien va a discutir: qué se puede jugar hoy, en qué plataforma y si de verdad merece la descarga. Forma parte del equipo editorial de Softonic y trabaja a diario con herramientas de IA en la producción de contenido.",
"fr-FR": "Emmanuel Bosque couvre les jeux vidéo chez Softonic : sorties, mises à jour qui transforment discrètement un jeu en un autre, et une industrie qui prévient rarement à l'avance. Il écrit pour celui qui va jouer, pas pour celui qui va débattre : ce qui est jouable aujourd'hui, sur quelle plateforme, et si le téléchargement en vaut la peine. Il fait partie de l'équipe éditoriale de Softonic et travaille au quotidien avec des outils d'IA dans la production de contenu.",
"it-IT": "Emmanuel Bosque si occupa di videogiochi su Softonic: uscite, aggiornamenti che trasformano un gioco in un altro senza dirlo e un'industria che quasi mai avvisa in anticipo. Scrive per chi ha intenzione di giocare, non per chi ha intenzione di discutere: cosa si può giocare oggi, su quale piattaforma e se vale davvero il download. Fa parte del team editoriale di Softonic e lavora ogni giorno con strumenti di IA nella produzione dei contenuti.",
"nl-NL": "Emmanuel Bosque schrijft bij Softonic over videogames: releases, updates die een spel stilletjes in een ander spel veranderen, en een industrie die haar stappen zelden vooraf aankondigt. Hij schrijft voor wie gaat spelen, niet voor wie gaat discussiëren: wat je vandaag kunt spelen, op welk platform en of de download het waard is. Hij maakt deel uit van de redactie van Softonic en werkt dagelijks met AI-tools in de contentproductie.",
"pl-PL": "Emmanuel Bosque zajmuje się grami w Softonicu: premierami, aktualizacjami, które po cichu zmieniają grę w zupełnie inną, i branżą, która rzadko uprzedza o swoich ruchach. Pisze dla tych, którzy chcą zagrać, a nie dla tych, którzy chcą się spierać: w co można zagrać dziś, na jakiej platformie i czy naprawdę warto pobierać. Należy do zespołu redakcyjnego Softonica i codziennie korzysta z narzędzi AI w produkcji treści.",
"pt-BR": "Emmanuel Bosque cobre games na Softonic: lançamentos, atualizações que transformam um jogo em outro sem avisar e uma indústria que raramente anuncia seus movimentos com antecedência. Escreve para quem vai jogar, não para quem vai discutir: o que dá para jogar hoje, em qual plataforma e se vale mesmo o download. Faz parte da equipe editorial da Softonic e trabalha diariamente com ferramentas de IA na produção de conteúdo."
}
View all posts by Emmanuel Bosque
