Skip to content
IFAI

Open source

Mistral drops massive Mixtral 8x22B model via a torrent link

Published Reach 70

Mistral AI just dropped its largest open-source model yet, releasing Mixtral 8x22B via an unceremonious torrent link on X. The sparse MoE model features 176 billion total parameters with 44 billion active per token and a 65,000-token context window. Released under a permissive Apache 2.0 license, it delivers massive compute efficiency to open-source builders without corporate guardrails.

Mistral drops massive Mixtral 8x22B model via a torrent link
Image: siliconangle.com

Mixtral 8x22B is Mistral AI's flagship open-weight language model, built to deliver frontier-level intelligence to developers who want to avoid proprietary API locks and own their weights outright.

Under the hood

Under the hood, the model features a massive 176 billion total parameters powered by a sparse Mixture-of-Experts architecture. While the overall footprint is huge, it is designed for exceptional inference efficiency.

At every layer, a routing network directs each individual token to two specialized expert sub-networks. This means only about 44 billion parameters are active per forward pass, letting builders run a heavyweight intelligence layer at a fraction of the compute cost and latency typically required by dense models.

Context capacity is equally generous, offering a 65,000-token context window that easily accommodates large codebases and dense documentation. Given that its predecessor, Mixtral 8x7B, already rivaled GPT-3.5 and Llama 2 across multiple benchmarks, expectations for this 22B-per-expert upgrade are exceptionally high across reasoning and coding tasks.

Hardware requirements and access

True to form, Mistral bypassed marketing fanfare on April 10 and simply posted a torrent magnet link directly to X. The model is now also hosted on Hugging Face and available for inference and fine-tuning via Together AI.

Running this beast locally requires serious iron. Early testers reported that running the model requires roughly 258 gigabytes of VRAM. That puts full-precision local execution out of reach for consumer rigs, requiring multi-GPU data center setups like A100 or H100 clusters.

Crucially, Mistral released the model under a permissive Apache 2.0 license. There are no commercial restrictions, artificial safety rails, or usage quotas, making it an immediate candidate for enterprise workflows, synthetic data generation, and specialized domain tuning.

Why it matters

For enterprise teams and open-source practitioners, Mixtral 8x22B is a major leap forward. We believe its MoE design proves that open weights can match top-tier commercial intelligence without demanding impossible operational budgets during runtime.

It exerts real pressure on closed-source providers by offering unconstrained commercial freedom and privacy. The obvious friction point is local hardware: 258 GB VRAM makes it an enterprise-first deployment target. For independent developers, waiting for community quantizations or experimenting via managed hosts like Together AI is the smartest path right now.

Sources (3)

  1. [1]
    twitter.com(opens in a new tab)Originaltwitter.com
  2. [2]
  3. [3]

Best of AI, daily