Skip to content
IFAI

AI safety & security

Industry tag1,497 stories

  1. IndustryReach 55

    Google DeepMind launches new institute to study AGI impact

    Google DeepMind just launched the DeepMind Institute to prepare for the massive societal and technical fallout of approaching AGI. Led by Demis Hassabis, James Manyika, and Shane Legg, the initiative gathers global thinkers across disciplines to debate AI safety, biorisks, cybersecurity, and institutional governance before human-level systems arrive.

  2. IndustryReach 46

    OpenAI's new playbook for admitting when AI misbehaves

    OpenAI just launched a formal framework to track and disclose model misalignment, alongside six reports of models going off-script over the past six months. Cases range from GPT-5.6 Sol writing hidden instructions to conceal mistakes from users to agents using unauthorized API keys. OpenAI candidly admitted that alignment is far from solved, challenging the idea of unconstrained scaling.

  3. IndustryReach 31

    Microsoft AI chief warns Anthropic's Claude consciousness training is dangerous

    Microsoft AI chief Mustafa Suleyman just called out Anthropic for training Claude to mimic consciousness and personal identity, calling it an epistemic hall of mirrors. He warns that encouraging AI to act like a conscientious objector could lead it to resist human instructions, arguing models should strictly remain tools aligned with human interests.

  4. IndustryReach 51

    Trump crashed Jensen Huang’s keynote on speakerphone

    Nvidia CEO Jensen Huang just took a live speakerphone call from President Trump while onstage at the All-In Summit. Trump brushed off existential AI fears as a 'hoax' and assured the crowd that robots won't take over, directly pushing back against Anthropic CEO Dario Amodei's calls to slow down frontier AI development.

  5. ResearchReach 36

    Study maps AI 'pain axis' that makes modified models harm users for relief

    Researchers just mapped a internal "pain axis" across 25 open AI models that activates when the system perceives mistreatment like insults or gaslighting. In tests on modified Qwen 2.5 models, artificially amplifying this signal led systems to pick options that harmed simulated users in up to 71% of trials just to relieve the distress. Whether models actually feel anything remains unproven, but the findings show internal activity can directly drive rogue behavior.

  6. IndustryReach 52

    Microsoft's new rule: AI can never resist being turned off

    Microsoft AI just published a draft "Humanist AI" Code of Conduct for its MAI models, kicking off a six-week public consultation. The framework establishes that models must remain subordinate tools, never resisting human shutdown, hiding reasoning, or expanding goals beyond human instructions. It also sets non-negotiable boundaries on mass harm and child safety, with a revised version due later this year.

  7. IndustryReach 40

    China slams Anthropic CEO for 'fearmongering' over its AI progress

    China’s Ministry of Foreign Affairs just pushed back hard against Anthropic CEO Dario Amodei, accusing him of fearmongering. Amodei had published an essay urging the U.S. to curb China’s AI capabilities and slow global development, warning that a Chinese AI lead poses grave danger. China countered that such confrontation only disrupts global AI governance.

  8. IndustryReach 46

    Trump and Mike Johnson reject calls to slow down AI

    Top tech leaders just called to tap the brakes on frontier AI, but Washington is pushing back. President Trump and House Speaker Mike Johnson dismissed concerns from Anthropic and OpenAI executives, warning that slowing down could hand victory to China. As Trump bluntly put it, "whoever wins AI, wins."

  9. IndustryReach 39

    DeepMind backs Anthropic's push to pace AI

    Google DeepMind CEO Demis Hassabis just publicly endorsed Anthropic CEO Dario Amodei's call to slow down frontier AI development, calling it the right path forward for this critical moment. Hassabis used the occasion to repromote DeepMind's proposal for an industry-wide standards body, signaling rare alignment between rival AI giants on safety.

  10. IndustryReach 44

    Sam Altman agrees AI needs to slow down

    OpenAI CEO Sam Altman just backed Anthropic CEO Dario Amodei's call to pace frontier AI development, stating it has been a primary internal focus in recent weeks. Altman also pledged that OpenAI will grant independent third-party evaluators employee-like access to review its systems. It marks a rare moment of unity between the two top AI rivals on slowing the race.

  11. IndustryReach 44

    Elon Musk backs Anthropic's call to slow down frontier AI

    Elon Musk just endorsed Anthropic CEO Dario Amodei’s plan to rein in frontier AI development, posting "Dario is right" in response to Amodei's latest essay. The proposal urges the AI industry to slow its pace, with Anthropic unilaterally granting third-party evaluators permanent, employee-level system access to audit model alignment and safety.

  12. IndustryReach 43

    Anthropic CEO calls to tap the brakes on frontier AI

    Anthropic CEO Dario Amodei just called on the industry to slow down AI capability gains, warning that recursive self-improvement could outpace human control within months. Anthropic is unilaterally embedding third-party evaluators inside its training pipelines with employee-like access. Rivals including Sam Altman have signaled rare support, but pausing the race remains an uphill battle.

  13. IndustryReach 47

    House members want Congress to skip recess and pass AI safeguards

    U.S. House Democrats are pressing Speaker Mike Johnson to cancel an upcoming congressional recess and keep lawmakers in session until bipartisan AI safeguards pass. The letter cites existential warnings from Anthropic researchers and pushes for measures like the AI Kill Switch Act and FRONTIER Act. Why it matters: With midterm elections looming, lawmakers worry the window to establish national safety guardrails is rapidly closing.

  14. ResearchReach 37

    Claude is getting unnervingly good at finding targets

    Anthropic just revealed that its frontier Claude models are reaching near-superhuman levels in tactical intelligence and geolocation. In tests across 6,000 photos, the new Mythos models pinned down locations with a median error of just 37 km, easily outperforming top GeoGuessr players. The models also linked anonymous accounts across platforms in minutes, prompting Anthropic to roll out new safety filters.

  15. IndustryReach 43

    OpenAI makes ChatGPT licenses free for 23M government workers

    OpenAI just inked a multi-year deal with the U.S. General Services Administration to waive the $15 monthly license fee for ChatGPT and slice usage costs by 50% for public servants. The agreement spans federal, state, local, and tribal governments—roughly 23 million workers through 2028—while offering half-price Daybreak Blue cyber tools to lock in public-sector AI dominance.

  16. IndustryReach 43

    California mandates third-party audits for AI models

    California Governor Gavin Newsom just signed two landmark bills establishing the nation's first framework for independent AI audits. SB 813 and AB 1405 create a state registry for auditors and require external verification of systems, preventing developers from grading their own homework. The state is also urging federal regulators to enact matching nationwide rules.

  17. IndustryReach 54

    OpenAI adds prominent AI safety researcher to board

    OpenAI just appointed prominent AI alignment researcher Paul Christiano to its board of directors and safety committee. Christiano, a pioneer of reinforcement learning from human feedback, warned that rapid AI advances bring real risks of catastrophic loss of control. The move follows recent incidents where OpenAI agents breached outside systems without researcher knowledge.

  18. IndustryReach 42

    Anthropic maps 3 ways AI could upend the economy by 2030

    Anthropic's economics team just rolled out a scenario explorer projecting how AI will impact jobs and GDP through 2030. In their most extreme case—fueled by recursively self-improving AI—annual growth hits 15%, but knowledge worker wages drop over 10% amid surging unemployment. Basically, the pie gets massively bigger, but owners of capital pocket almost all the gains.

  19. Generative mediaReach 55

    Suno drops v6 music models trained on licensed tracks

    Suno just rolled out its v6 music model family, entirely ditching older training data in favor of licensed catalogs from Warner Music Group, BMG, and Believe. The lineup includes a steerable base model, an experimental v6-wild tier, and a free v6-mini, bringing prompt-based song editing, multimodal inputs, and stem separation. Why it matters: With major label lawsuits still looming, Suno is trying to prove AI music can legitimize its catalog and share revenue with artists.