Kimi open-sources its 2.8T MoE monster K3
Kimi just open-sourced Kimi K3, a massive 2.8-trillion parameter MoE model featuring native vision understanding and a 1-million-token context window. The team claims a new architecture delivers 2.5x the intelligence per unit of compute, and they are also releasing the full underlying stack, from custom attention kernels to scalable agent infrastructure.