IBM blends Mamba and Transformer in new Granite 4 models
IBM just open-sourced Granite 4, a new language model family combining Transformer attention with Mamba-2 state space architecture. The models range in size from 3 billion to 32 billion parameters. In benchmarks, the 7B hybrid model consumed just 15GB of RAM—one-sixth of its predecessor—dramatically lowering long-prompt inference costs.