Skip to content
IFAI

Open source

Liquid AI dropped an experimental 3B model that punches way above its weight

Published Reach 57

Liquid AI just rolled out LFM2-2.6B-Exp, an experimental checkpoint built entirely with pure reinforcement learning. Despite its 2.6B size, it outperforms competing 3B models across instruction, knowledge, and math benchmarks, even topping DeepSeek R1-0528 on IFBench despite being 263 times smaller. The weights are already live on Hugging Face.

Liquid AI dropped an experimental 3B model that punches way above its weight
Image: x.com

LFM2-2.6B-Exp is a 2.6-billion-parameter checkpoint built for anyone who wants an obedient, surprisingly capable reasoning model running locally on edge hardware. If you need a compact assistant that can actually follow strict instructions and call tools without melting your laptop, the weights are ready to grab on Hugging Face.

What it can do

Liquid AI designed this model to punch well above the typical 3B class in instruction following, knowledge retrieval, and math.

The standout benchmark is IFBench, which tests how reliably a model sticks to complex, constrained formatting rules. LFM2-2.6B-Exp managed to outscore DeepSeek R1-0528, a frontier model with 263 times more parameters.

Even before this pure RL stage, its base checkpoint posted 82.41 percent on GSM8K and 79.56 percent on IFEval, outpacing rivals like Llama 3.2 3B Instruct, Gemma 3 4B it, and SmolLM3 3B. This release tightens those behaviors even further.

It also comes with native tool calling tokens baked in. It parses JSON declarations, emits Python-style tool requests, and reads outputs out of the box. Plus, it supports dynamic hybrid reasoning via special think tokens when hit with complex prompts.

How it works and hardware specs

The secret sauce here is sequential pure reinforcement learning stacked on top of an already aligned model. Liquid AI skipped the typical SFT warm-up and distillation in this final tuning run.

Instead, they ran pure RL with verifiable rewards across instruction following first, followed by knowledge tasks, math problems, and light tool use. The underlying weights change policy, not foundational architecture.

Under the hood, it uses Liquid's hybrid setup: 30 layers in total, blending 22 double-gated LIV convolution blocks with 8 grouped query attention (GQA) blocks. This structure dramatically cuts KV cache overhead, making inference remarkably snappy on consumer GPUs and NPUs.

It features a 32,768 token context window, a 65,536 vocabulary, and bfloat16 precision. The training mix spans English, Chinese, French, German, Japanese, Korean, Spanish, and Arabic.

Why it matters

If you build local AI agents or need a reliable edge controller, this checkpoint solves the classic 3B headache: small models ignoring half your prompt constraints. It brings frontier-like rule adherence down to hardware anyone owns.

Just keep expectations realistic. Pure RL sharpens tasks with verifiable rules like math and formatting, but a 2.6B model still has a hard ceiling on general world knowledge. As an edge tool caller, though, it looks like one of the sharpest small checkpoints you can deploy today.

Sources (2)

  1. [1]
    @liquidai(opens in a new tab)Originalx.com
  2. [2]

Best of AI, daily