Tencent drops Hunyuan-TurboS: a Mamba-Transformer hybrid at 1/7th the cost
Tencent Hunyuan just unveiled Hunyuan-TurboS, an ultra-large MoE model blending Transformer and Mamba architectures to ease long-context training and KV-cache overhead. The team claims it tops GPT-4o and DeepSeek-V3 in math and reasoning, all while cutting inference costs to one-seventh of its predecessor.