MiniMax goes open-source with 4M-token context models
MiniMax just open-sourced its new MiniMax-01 series, featuring a 456B-parameter language model and a visual multimodal model. Built on a novel Lightning Attention architecture with linear complexity, the models handle up to 4 million tokens of context with virtually zero loss. Weights are available on GitHub alongside access via MiniMax Chat.