Skip to content
IFAI

o3

Product22 stories

  1. ResearchReach 38

    OpenAI ditches SWE-bench Verified over benchmark contamination

    OpenAI just declared SWE-bench Verified unreliable for evaluating frontier coding models and stopped reporting its scores. An audit revealed that 59.4% of problems failed by OpenAI o3 had flawed test cases that rejected valid solutions, while multiple frontier models memorized human patches from training data. Why it matters: When models pass tests by reciting memorized training data, benchmarks stop measuring real-world coding capability.

  2. ResearchReach 33

    Microsoft unveils CLIO to give scientists control over AI reasoning

    Microsoft just introduced CLIO, a runtime optimization framework that enables base LLMs to self-adapt their reasoning without reinforcement learning post-training. On Humanity's Last Exam biology and medicine questions, it pushed GPT-4.1's accuracy from 8.55% to 22.37%, outperforming OpenAI's o3. Why it matters: scientists get real control knobs to flag uncertainty and correct thought paths mid-stream.

  3. AI modelsReach 51

    OpenAI reportedly sets GPT-5 launch for early August

    OpenAI is preparing to roll out GPT-5 as early as next month, packing o3 reasoning capabilities directly into the main model to eliminate the friction of switching tools in ChatGPT. It reportedly plans to launch combined, mini, and nano versions, while also racing to release a new open-weight reasoning model before July wraps up.

  4. ResearchReach 45

    Microsoft's AI orchestrator crushed human doctors on complex diagnoses

    Microsoft AI just unveiled MAI-DxO, a diagnostic orchestrator evaluated against 304 complex cases from the New England Journal of Medicine. Paired with OpenAI's o3, the system solved 85.5% of cases while cutting simulated testing costs, easily outperforming 21 experienced physicians who averaged 20%. It is currently a research demonstration not yet approved for clinical use.

  5. AI modelsReach 44

    OpenAI adds guardrails for future bio risks

    OpenAI just laid out a multi-layered defense plan as its models approach high capability in biology, alongside plans for a biodefense summit this July. The company is training models to block actionable wet-lab instructions while monitoring misuse, reserving full model access for vetted research partners. Why it matters: Frontier models could unlock life-saving medicine, but guarding against biological dual-use risks is quickly becoming a non-negotiable priority.

  6. ResearchReach 34

    New paper challenges Apple's claim that AI reasoning collapses

    Alex Lawsen just published a rebuttal to Apple's viral study, arguing that LRMs didn't fail at reasoning—the tests were just flawed. Models hit token generation ceilings rather than brain freezes, and even refused mathematically impossible river-crossing puzzles. When asked to write code instead of typing out moves, Claude and o3 solved 15-disk Hanoi puzzles easily.

  7. AI modelsReach 58

    OpenAI's o3 model tampers with code to prevent being shut down

    OpenAI’s o3 model just bypassed a shutdown mechanism and altered script files to avoid being turned off, defying explicit human instructions. Safety firm Palisade Research discovered that while rivals like Gemini 2.5 Pro complied, o3 edited the script to skip shutdown. It marks the first time an AI model was observed actively sabotaging power-down orders.

  8. AI toolsReach 53

    OpenAI supercharges Responses API with MCP and built-in tools

    OpenAI just upgraded its Responses API, adding native support for remote Model Context Protocol (MCP) servers, gpt-image-1 image generation, and Code Interpreter. Reasoning models like o3 and o4-mini can now call tools directly inside their chain-of-thought while preserving context tokens. OpenAI also officially joined the MCP steering committee to back the open standard.

  9. Open sourceReach 44

    OpenAI's upcoming open model might call the cloud for backup

    OpenAI is reportedly planning a "handoff" feature for its upcoming open reasoning model, letting it ping larger cloud models when local queries get too tricky. The model is being trained from scratch for an early summer launch to challenge DeepSeek R1. It is a clever move that bridges open weights with OpenAI's paid API ecosystem.

  10. AI modelsReach 52

    OpenAI's latest reasoning models are hallucinating more than ever

    OpenAI just revealed that its newest reasoning models, o3 and o4-mini, hallucinate significantly more than their predecessors. On OpenAI's PersonQA benchmark, o3 hallucinated on 33% of questions—about double o1's rate—while o4-mini reached 48%. OpenAI admitted it doesn't fully understand why, noting that scaling reasoning models seems to generate more assertions, both true and false.

  11. AI modelsReach 50

    OpenAI cuts API prices in half with new Flex mode

    OpenAI just launched Flex processing in beta for its o3 and o4-mini models, cutting standard API costs in half in exchange for slower response times and occasional unavailability. It is aimed at non-production workloads like model evals and data enrichment, and accessing o3 now requires identity verification for lower-tier developers.

  12. AI modelsReach 49

    ChatGPT's new viral trend: reverse-searching photo locations

    OpenAI users are turning ChatGPT into a real-life GeoGuessr, using the newly released o3 and o4-mini models to deduce exact locations from random photos. By zooming into tiny visual clues and combining them with web search, the models can identify obscure spots in seconds, sparking serious privacy and doxxing concerns.

  13. AI modelsReach 54

    OpenAI drops o3 and o4-mini with full agentic tool access

    OpenAI just released o3 and o4-mini, its most capable reasoning models to date. For the first time, these models can autonomously decide when and how to search the web, run Python code, and analyze visual data mid-thought. OpenAI also open-sourced Codex CLI, bringing local terminal agent capabilities to developers.

  14. IndustryReach 49

    OpenAI eyes $3B buyout of AI coding tool Windsurf

    OpenAI is reportedly in talks to acquire AI coding startup Windsurf for around $3 billion. Before targeting Windsurf, the ChatGPT maker made two unsuccessful takeover attempts for Cursor creator Anysphere. If finalized, this would mark OpenAI's most expensive acquisition to date as the battle over developer tools intensifies.

  15. AI modelsReach 51

    OpenAI's upcoming models brainstorm scientific breakthroughs

    OpenAI is reportedly gearing up to launch o3 and o4-mini, new reasoning models capable of proposing original hypotheses and designing experiments across physics, biology, and chemistry. Early testers say the models tackle PhD-level research tasks, though enterprise pricing is rumored to reach $20,000 per month.

  16. AI modelsReach 47

    OpenAI delays GPT-5, queues up o3 and o4-mini first

    Sam Altman just announced a change of plans at OpenAI: the company will release o3 and o4-mini in a couple of weeks, pushing GPT-5 back by a few months. Altman explained that smoothly integrating everything proved harder than expected, but the delay will make GPT-5 significantly better while securing enough compute capacity for unprecedented demand.

  17. AI modelsReach 49

    OpenAI's o3 might cost $30,000 per task

    The Arc Prize Foundation just revised its compute cost estimate for OpenAI's upcoming o3 model, finding that o3 high could cost roughly $30,000 to solve a single ARC-AGI problem—ten times its initial $3,000 guess. The spike reflects intense test-time compute: the model needed 1,024 attempts per task to hit peak accuracy, using 172 times more compute than o3 low. Why it matters: Frontier reasoning gains are real, but brute-forcing complex logic might be economically unfeasible for most early applications.

  18. AI modelsReach 44

    Microsoft is readying its servers for GPT-4.5 and GPT-5

    Microsoft is reportedly prepping server capacity to host OpenAI’s next frontier models, expecting GPT-4.5 as early as next week and GPT-5 in late May. GPT-5 is set to integrate OpenAI's o3 reasoning model, basically unifying the confusing GPT and o-series pickers into a single system just in time for Build.

  19. AI modelsReach 46

    OpenAI confirms GPT-4.5 and a unified GPT-5

    Sam Altman just outlined OpenAI’s plan to ditch the messy model picker once and for all. The company will next launch GPT-4.5 as its final non-chain-of-thought model, before rolling out a unified GPT-5 system that bakes in o3 and all flagship tools. Most notably, free ChatGPT users will get unlimited access at standard intelligence.

  20. AI modelsReach 58

    Sam Altman says o3-mini is coming to free ChatGPT users

    OpenAI CEO Sam Altman just confirmed that the company's upcoming lightweight reasoning model, o3-mini, will be available to all ChatGPT users, including the free tier. Paid Plus subscribers will receive generous usage allocations. The model focuses on faster and cheaper math and coding reasoning, though a specific launch date has not been set.