Skip to content
IFAI

Subquadratic

Company1 story

  1. AI modelsReach 42

    SubQ brings 12M-token context with sparse attention

    Subquadratic just introduced SubQ, a frontier model featuring a 12 million token context window powered by sub-quadratic sparse attention. At 1MM tokens, it runs 52x faster than FlashAttention at under 5% of Opus's cost, cutting compute by nearly 1,000x.