Linum open-sources Pyramid-JiT: A $21K text-to-image model
A two-person lab called Linum just open-sourced Pyramid-JiT, a 2B-parameter text-to-image model trained entirely from scratch for only $21,000. It ditches the standard VAE to generate images directly in pixel space, delivering solid visuals on a shoestring budget. While it struggles with text and complex anatomy, the Apache 2.0 release proves training diffusion models doesn't require millions.