Nvidia's new Nemotron Ultra takes on DeepSeek R1 at half the size
Nvidia just released Llama-3.1-Nemotron-Ultra-253B-v1, a fully open-source dense model built on Meta's 405B base. By overhauling the architecture to fit on a single 8x H100 node, it edges out the massive 671B DeepSeek R1 on benchmarks like GPQA and LiveCodeBench, though DeepSeek still leads in heavy math.