OpenAI quietly killed an internal AI model code-named Arrakis earlier this year after it failed to meet efficiency targets, according to The Information. Built alongside GPT-4 to drastically lower the eye-watering compute costs of running apps like ChatGPT, the setback left some Microsoft executives disappointed. It shows that slashing inference expenses remains a brutal hurdle, even for AI's market leader.
Baidu CEO Robin Li just unveiled Ernie 4.0 at an event in Beijing, boldly claiming the new model is not inferior to OpenAI's GPT-4 in any aspect. The update brings major upgrades to understanding, reasoning, generation, and memory, and will plug directly into Baidu Search and Maps. Markets reacted cautiously, with shares dipping slightly after the demo.
The SEC's Gary Gensler just warned that an AI-triggered financial crisis is "nearly unavoidable" by the late 2020s or early 2030s. The danger isn't necessarily one reckless trader, but entire Wall Street institutions quietly relying on the same underlying foundation model or data aggregator. Why it matters: Regulators are built to police individual banks, making systemic AI monocultures a massive blind spot.
Portkey just revealed that GPT-4 latency has steadily dropped over the past three months, effectively cutting 99th-percentile wait times by more than half. While complex prompts still spike processing, median latencies now sit comfortably below 1ms per token. It is still pricier, but speed is no longer the bottleneck holding teams back.
OpenAI is reportedly planning major developer updates at its upcoming November 6 conference to slash costs by up to 20 times. The upgrades include a memory-enabled stateful API to curb token usage and vision capabilities for analyzing images. Why it matters: OpenAI wants to cement its platform as the default infrastructure before startups defect to open-source alternatives.
OpenAI is exploring building its own custom AI chips to tackle the GPU crunch and reduce its reliance on Nvidia, according to Reuters. CEO Sam Altman has reportedly made acquiring more chips a top priority, with options including in-house design or acquisitions. Why it matters: Running models like ChatGPT costs tens of billions of dollars, but custom silicon is a risky bet that takes years.
OpenAI just added voice conversations and image analysis to ChatGPT. Users can now snap photos to troubleshoot broken grills or plan dinner recipes, and chat back and forth using five realistic synthetic voices. The multimodal upgrade rolls out to Plus and Enterprise users over the next two weeks.
OpenAI just launched the Red Teaming Network, calling on domain experts worldwide to rigorously stress-test and evaluate its AI models. Members are compensated for their work under NDAs and can commit as little as 5 to 10 hours a year. Why it matters: It shifts OpenAI's model evaluations from one-off audits into a continuous, diverse collaborative defense.
OpenAI is reportedly rushing to roll out multimodal image capabilities to GPT-4, aiming to preempt Google's upcoming Gemini model. The update, dubbed GPT-Vision alongside a next-gen model codenamed Gobi, will finally make visual inputs like sketches and charts widely available. Why it matters: Google was primed to steal the AI spotlight this fall, and OpenAI is moving aggressively to spoil those plans.
Microsoft quietly pumped millions of gallons of water into its Iowa data centers to cool the supercomputers that trained OpenAI's GPT-4. Researchers estimate that ChatGPT consumes about 500 milliliters of water for every 5 to 50 prompts you ask. Why it matters: As the generative AI race heats up, the invisible environmental toll of keeping these giant models cool is facing serious local and public pushback.
ChatGPT's web visits just fell for the third consecutive month in August, with average time on site dropping to 7 minutes. However, the decline slowed significantly to 3% compared to 10% drops earlier in the summer, and US traffic even ticked up slightly. Similarweb attributes the dip largely to school holidays, noting traffic stabilized as students headed back to class.
A newly published excerpt from Walter Isaacson's biography reveals Elon Musk tried to merge OpenAI into Tesla before walking away in 2018. OpenAI rejected the proposal, prompting Sam Altman to create a for-profit arm that brought in billions from Microsoft. Sidelined from the boom, Musk eventually launched xAI to settle the score.
OpenAI just released a comprehensive guide for teachers bringing ChatGPT into classrooms, packed with starter prompts and notes on AI detector limits. It showcases real-world uses like role-playing debates, quiz crafting, and ESL practice, while reminding educators that AI outputs always require human verification.
SemiAnalysis just dropped a deep dive revealing Google is accelerating Gemini training to beat GPT-4's pre-training compute by 5x by year-end, and up to 20x next year. The report divides the AI field into GPU-rich giants and struggling GPU-poor startups, noting Google's TPUv5 buildout may be the only force capable of breaking Nvidia's market dominance.
Meta is reportedly gearing up to train Llama 3 and Llama 4, with plans to bring Llama 3 up to GPT-4's performance while keeping it freely accessible under its open license. The detail surfaced from OpenAI researcher Jason Wei at a Meta event. If true, Meta is doubling down on commoditizing frontier models to rival closed labs.
OpenAI just detailed a new system using GPT-4 to handle content moderation and lighten human workloads. Policy experts write rules into prompts, compare the model's flags against human labels, and refine definitions on the fly. OpenAI claims it cuts policy rollout time down to hours, though human oversight is still strictly required to catch model bias.
ChatGPT just scored in the top 1% for originality and fluency on the Torrance Tests of Creative Thinking, a standard benchmark used for decades. Powered by GPT-4 and graded blindly against thousands of college students, it only slipped slightly to the 97th percentile for flexibility. Generative AI is no longer just fast at brainstorming—it is matching the most creative human minds.
A report from Analytics India Magazine claims OpenAI spends around $700,000 every day to keep ChatGPT running, raising alarms about potential bankruptcy by late 2024. Despite heavy backing from Microsoft, shrinking web traffic and rising pressure from open-source alternatives like Llama 2 are straining its path to profitability.
OpenAI just launched GPTBot, a web crawler designed to collect publicly available web data to train future models like GPT-5. The crawler automatically filters out paywalls, personal data, and policy-violating content. Website owners can opt out by adding a "disallow" command to a standard file on their server.
Microsoft just launched its Azure ND H100 v5 virtual machines, packing eight NVIDIA H100 GPUs and Quantum-2 InfiniBand networking for massive AI workloads. The cloud giant also expanded Azure OpenAI Service to five new regions, broadening access to models like GPT-4 as enterprise adoption surges. Why it matters: Microsoft is rapidly scaling up hardware muscle to meet insatiable cloud AI demand.
