Sakana AI unveils CycleQD to build multi-skilled models without fine-tuning
Sakana AI researchers just developed CycleQD, an evolutionary framework that merges specialized small models into multi-skilled AI swarms without expensive fine-tuning. By using model merging and SVD for crossover and mutation, it outpaced traditional fine-tuning on Llama 3-8B tests, offering a cheaper path to balanced AI agents.