Skip to content
IFAI

Strata

Product2 stories

  1. Open sourceReach 48

    ISTA-DASLab fits 763B DeepSeek-V4.1 onto a 12GB GPU

    ISTA-DASLab just released non-uniform GSQ-RCO GGUF quantizations for DeepSeek-V4.1-Flash-1017, compressing the 763B MoE down to as low as 1.75 bpw. Paired with the Strata inference engine, the massive model runs on a single consumer 12GB GPU while the 2.00 bpw build retains 100% of the base model's task performance. Why it matters: Running frontier-tier open models locally no longer requires a server rack.

  2. Open sourceReach 48

    Run 100B+ models on a 12GB GPU with Strata

    Strata just open-sourced a cross-platform inference engine that runs massive models like Qwen3.8-Flash-Next on consumer PCs with just 12GB of VRAM. It tiers execution across your GPU, RAM, and SSD while exposing local OpenAI and Anthropic-compatible APIs. Why it matters: massive frontier models are officially leaving the cloud and moving straight onto everyday desktop hardware.