Meta just rolled out Code Llama 70B, a larger coding model trained on 500 billion tokens with a massive 100,000-token context window. It arrives in base, Python-specialized, and instruction-tuned variants, all freely downloadable for commercial and research use under Meta’s permissive open license.
OpenAI just launched two new embedding models—text-embedding-3-small and large—bringing stronger retrieval benchmarks and adjustable dimensions to cut storage costs. It also slashed GPT-3.5 Turbo input pricing by 50% and shipped an updated GPT-4 Turbo preview to tackle code completion laziness. Why it matters: Developers get better RAG retrieval and cheaper tokens across the board.
Mark Zuckerberg just confirmed that Meta is actively training Llama 3, aiming for state-of-the-art coding and reasoning capabilities to pursue AGI. To power the push, Meta is stockpiling over 340,000 Nvidia H100 GPUs by the end of 2024, building a computing fortress that rivals almost any competitor in the industry.
ChatGPT sparked wild speculation after telling multiple users it was secretly powered by a new "gpt-4.5-turbo" model. OpenAI staff and CEO Sam Altman quickly poured cold water on the rumor, explaining it is simply a weird, oddly consistent hallucination rather than an unannounced upgrade.
Google just launched the Gemini Pro and Gemini Pro Vision APIs for developers and enterprise customers. The models feature a 32K context window, function calling, and support across 38 languages. Devs can experiment for free via Google AI Studio with up to 60 requests per minute before paid tiers arrive next year.
Microsoft just released Phi-2, a 2.7B parameter language model trained on textbook-quality synthetic and web data. Despite its compact footprint, it matches or outperforms models up to 25x larger like Llama-2-70B on complex reasoning and coding benchmarks without RLHF. Why it matters: it demonstrates that strategic data curation can unlock emergent reasoning even in lightweight models.
Meta just released an interactive demo for Audiobox, its new foundation research model for audio generation. The playground allows users to test zero-shot TTS, generate custom sound effects from text, and experiment with audio infilling. It gives creators an early hands-on look at Meta's generative audio capabilities.
A developer just rebuilt Google's heavily edited Gemini video demo using OpenAI's GPT-4V to prove real-time multimodal interaction is already possible. The custom setup correctly handled hand gestures, live drawings, and rock-paper-scissors in real time, with the open-source code now shared on GitHub.
xAI's flagship bot Grok was caught denying user requests by stating it violates OpenAI's use case policy, an awkward slip for Elon Musk's rival AI. While xAI claimed the bot merely swept up ChatGPT outputs during web scraping, researchers suspect it was fine-tuned on synthetic OpenAI data.
Elon Musk just officially launched xAI's chatbot Grok, rolling it out exclusively to Premium+ subscribers on X. Powered by Grok-1, the bot is designed with a rebellious streak and a sarcasm-heavy 'fun' mode. It's Musk's latest push to convert casual social users into paying subscribers for his everything-app vision.
The Stable LM team just released Stable LM Zephyr 3B, a 3-billion-parameter chat model that is 60% smaller than typical 7B alternatives. Tuned with Direct Preference Optimization (DPO), it delivers responsive instruction-following and Q&A on consumer hardware without high-end GPUs. It is currently available under a non-commercial license.
Google just rolled out its new Gemini model to Bard, giving the chatbot its biggest boost yet. English users across 170+ countries can now tap a tuned version of Gemini Pro for text prompts, which Google claims outscores GPT-3.5 on key reasoning benchmarks. Next up: early next year, Bard Advanced will unlock the flagship Gemini Ultra.
Anthropic just released Claude 2.1, doubling its context window to an industry-leading 200,000 tokens—roughly 500 pages of text. The update halves hallucination rates compared to Claude 2.0, introduces system prompts, and adds beta tool use for API developers to connect external apps and data.
Microsoft just released Orca 2, a pair of small language models trained to use tailored reasoning strategies rather than blindly mimicking giant models. By learning when to reason step-by-step or answer directly, it matches or beats models 5 to 10 times larger on complex zero-shot benchmarks.
Google just pushed the release of its flagship AI model Gemini to early 2024, after previously telling cloud customers it would roll out in November. Positioned by DeepMind as its true competitor to GPT-4, the delay shows Google is still having a tough time catching up with OpenAI.
Google is rolling out Bard to teenagers across most countries, adding step-by-step math explanations and chart generation from tables. To protect younger users, the company added content filters for age-sensitive topics and an automatic double-check tool that verifies responses against web results to catch hallucinations.
OpenAI just paused new ChatGPT Plus sign-ups after a surge in usage following DevDay exceeded its server capacity. The team said the move is temporary to ensure existing users have a smooth experience, and waiting users can sign up inside the app to get notified when subscriptions reopen.
OpenAI CEO Sam Altman just confirmed the company has started training GPT-5, claiming the next-gen model could potentially cross into superintelligence. But building it won't be cheap—Altman noted that hitting AGI requires massive compute and data, meaning OpenAI will need billions more from Microsoft and other backers before it ever sees the light of day.
