Microsoft's 13B Orca mimics GPT-4's brain
Microsoft Research just unveiled Orca, a 13-billion-parameter model that learns by imitating the step-by-step reasoning processes of GPT-4. Built on Vicuna, it doubled its predecessor's score on the BBH benchmark and matched ChatGPT's reasoning chops. Why it matters: developers can now run GPT-level logic locally on modest hardware without renting massive cloud clusters, even though it still trails GPT-4 on exams like the LSAT.