Sakana AI turns text prompts into custom LoRA adapters
Sakana AI just unveiled Text-to-LoRA, a hypernetwork that generates task-specific LLM adapters directly from plain English prompts. Instead of gathering datasets and burning compute on fine-tuning, it creates LoRAs in a single step and even generalizes to unseen tasks. The code is open source ahead of ICML 2025.