Skip to content
IFAI

Open source

Meta drops Llama 3.3 70B with 405B performance at a fraction of the cost

Published Reach 49

Meta just introduced Llama 3.3 70B, a lightweight text model that delivers the punch of its massive 405B predecessor while running significantly cheaper. Armed with advanced post-training, it tops GPT-4o and Gemini 1.5 Pro on key benchmarks like MMLU, and is available for download right away.

Meta drops Llama 3.3 70B with 405B performance at a fraction of the cost
Image: techcrunch.com

Llama 3.3 70B is Meta’s latest open text model, built to deliver the punch of their massive 405B flagship at a fraction of the hardware footprint.

Basically, you get frontier-grade reasoning and language capabilities without having to assemble a private supercomputer to serve it.

What it can do

According to benchmarks shared by Meta’s VP of generative AI Ahmad Al-Dahle, Llama 3.3 70B beats out OpenAI’s GPT-4o, Google’s Gemini 1.5 Pro, and Amazon’s new Nova Pro on industry evaluations like MMLU.

Meta says users should see noticeable jumps across math, general knowledge, instruction following, and app tool use.

Whether you are building conversational agents or automated back-office pipelines, it packs enough muscle to handle heavy reasoning tasks right out of the box.

How it works and availability

The magic behind shrinking 405B performance down to 70B comes down to advanced post-training.

Al-Dahle noted that the team leaned heavily on recent post-training techniques, including online preference optimization, squeezing out core capabilities without ballooning parameter counts.

Weights are already up on Hugging Face and Meta’s official Llama site for direct download and commercial use.

The licensing terms match earlier releases: free for almost everyone, except consumer platforms boasting over 700 million monthly active users, who still need to request a custom commercial pass.

Why it matters

If you run on-premise hardware or build self-hosted AI apps, this is arguably the most compelling drop of the season. 405B was technically impressive but completely out of reach for regular developers, whereas a 70B model fits comfortably on standard multi-GPU setups.

Meta just raised the performance ceiling for open weights again. Matching or topping GPT-4o on standard tests with an accessible model size gives engineering teams a legit, affordable alternative to locked-down commercial APIs.

Sources (1)

  1. [1]
    techcrunch.com(opens in a new tab)Originaltechcrunch.com

Best of AI, daily