Skip to content
IFAI

NVIDIA H200

Product2 stories

  1. Open sourceReach 44

    NVIDIA supercharges Meta's Llama 3 across all its chips

    NVIDIA just rolled out full-stack optimizations for Meta's brand-new Llama 3 across its data center GPUs, edge devices, and PCs. In early benchmarks, a single H200 GPU churned out roughly 3,000 tokens per second on the 70B model, enough to handle 300 users simultaneously. The 8B model is also landing on RTX PCs and Jetson Orin modules.

  2. IndustryReach 41

    Nvidia supercharges AI computing with the H200 GPU

    Nvidia just unveiled the HGX H200 and H200 Tensor Core GPU, making it the first chip to feature ultra-fast HBM3e memory. The upgraded architecture delivers 141GB of capacity at 4.8 terabytes per second, nearly doubling prior limits. Server makers and cloud platforms can drop it right into existing infrastructure starting next year.