Liquid AI drops non-transformer models that rival top LLMs
MIT spinoff Liquid AI just released its first Liquid Foundation Models (LFMs), a trio of models completely ditching the standard transformer setup. Built on liquid neural networks, the models range from 1.3B to 40.3B parameters and can handle 1 million tokens with minimal memory overhead. It is a major proof that non-transformer architectures can take on today's frontier LLMs.