Meta's MobileLLM packs 7B punch into 350M mobile models
Meta just unveiled MobileLLM, a specialized architecture designed to squeeze capable language models under 1 billion parameters onto smartphones. By prioritizing network depth over width and sharing weights across blocks, its tiny 350M version matches the 7B LLaMA-2 on specific API tasks. Meta has open-sourced the pre-training code, setting up a new path for fast on-device assistants.