Qwen2 drops with 5 model sizes and 128K context
The Qwen team just launched Qwen2, an open-source model family spanning five sizes from 0.5B to 72B parameters. Trained on 27 additional languages, the flagship Qwen2-72B goes toe-to-toe with Llama-3-70B across major benchmarks, while context lengths stretch up to 128K tokens. Except for the 72B tier, all smaller models are now released under the Apache 2.0 license.