Musk powers up a 100k H100 monster cluster to build the next Grok
Elon Musk just fired up xAI's Memphis Supercluster, packing 100,000 liquid-cooled Nvidia H100 GPUs tied together on a single RDMA fabric. Musk boasts it is the world's most powerful AI training cluster and aims to deliver the strongest AI on every metric by December, though local utility contracts for its massive 100-megawatt power appetite are still not finalized.