Mamba-3 takes aim at Transformers with lower latency and 4% gains
Researchers Albert Gu and Tri Dao just released Mamba-3, an open-source state space model architecture under the Apache 2.0 license designed to outpace Transformers. Its MIMO variant hits a 57.6% average benchmark accuracy—a roughly 4% relative bump over Transformers—while matching Mamba-2's quality using half the state size. By introducing complex-valued states and cutting GPU idle time, it targets reasoning gaps and slashes inference latency.