ISTA-DASLab fits 763B DeepSeek-V4.1 onto a 12GB GPU
ISTA-DASLab just released non-uniform GSQ-RCO GGUF quantizations for DeepSeek-V4.1-Flash-1017, compressing the 763B MoE down to as low as 1.75 bpw. Paired with the Strata inference engine, the massive model runs on a single consumer 12GB GPU while the 2.00 bpw build retains 100% of the base model's task performance. Why it matters: Running frontier-tier open models locally no longer requires a server rack.