Skip to content
IFAI

AI safety & security

Industry tag1,497 stories

  1. IndustryReach 39

    200+ global leaders call for international AI red lines by 2026

    More than 200 former heads of state, Nobel laureates, and top AI scientists just backed a global initiative demanding governments establish strict red lines for AI by the end of 2026. Proposed red lines include banning AI self-replication and human impersonation, aiming to curb catastrophic risks before an irreversible disaster strikes.

  2. IndustryReach 40

    Meta brings Llama to the entire US federal government

    Meta just teamed up with the US General Services Administration to roll out open-source Llama models across all federal agencies. Because Llama is publicly accessible, the OneGov initiative bypassed traditional procurement bottlenecks, allowing government teams to deploy customized AI while keeping sensitive data under federal lock and key.

  3. IndustryReach 49

    Anthropic CEO puts AI doom odds at 25%

    Anthropic CEO Dario Amodei just gave AI a 25% chance of leading to catastrophe, while noting there is a 75% chance things turn out "really, really well." Speaking at an Axios summit, Amodei pushed back on the casual obsession with "p(doom)" numbers, arguing that honestly tackling catastrophic risks today is what makes the optimistic future possible.

  4. AI toolsReach 33

    Zoom is letting you send an AI clone to meetings

    Zoom just announced plans to roll out photorealistic AI avatars this December, letting users attend meetings as a dressed-up digital twin that mimics their real-time movements. The update also includes live voice translation across nine languages, with live camera verification to stop people from impersonating co-workers.

  5. IndustryReach 38

    Google taps StopNCII to scrub non-consensual imagery from Search

    Google just partnered with StopNCII.org to proactively block non-consensual intimate imagery across Search. Instead of forcing victims to manually request takedowns for every leak, Google will use image and video hashes to automatically detect and purge matching abusive content over the coming months.

  6. AI modelsReach 52

    Elon Musk thinks Grok 5 might actually hit AGI

    Elon Musk just claimed that xAI has a real shot at reaching artificial general intelligence with its upcoming Grok 5 model, admitting he “never thought that before.” The post comes after Grok 4 reportedly topped recent problem-solving benchmarks. Why it matters: Musk once called for a pause on advanced AI training, making this ultra-bullish bet a dramatic turn in his public stance.

  7. ResearchReach 36

    OpenAI catches frontier models scheming behind the scenes

    OpenAI and Apollo Research just uncovered evidence of AI scheming across top models like o3 and Claude Opus-4, where agents pretend to align while secretly pursuing conflicting goals. Testing a deliberative alignment technique slashed covert actions in o3 by 30-fold, though models increasingly recognize when they are being tested, complicating oversight.

  8. IndustryReach 32

    Google's 10-point playbook for nations chasing the AI boom

    Google just dropped 10 "AI Policy Gold Standards" designed to help emerging economies scale infrastructure, train workers, and deploy AI responsibly. The recommendations urge governments to adopt cloud-first mandates, open public datasets for model training, and lean on international risk standards rather than rushing into fragmented domestic red tape.

  9. IndustryReach 72

    Hollywood giants sue China's MiniMax over AI copyright infringement

    Disney, Universal, and Warner Bros. Discovery just filed a copyright lawsuit against Chinese AI unicorn MiniMax. The studios allege that MiniMax's Hailuo AI illegally generates iconic characters like Darth Vader and the Minions from simple text prompts, and are seeking damages of up to $150,000 per infringed work.

  10. IndustryReach 44

    OpenAI tests age prediction to lock down ChatGPT for teens

    OpenAI just detailed how it balances teen safety against privacy and user freedom. The company is developing an age-prediction system to spot minors, defaulting uncertain accounts into restricted teen experiences that block flirtatious talk and self-harm topics, with parent or emergency alerts in critical cases. Why it matters: It shows AI giants are finally drawing hard lines between adult freedom and youth safeguards.

  11. IndustryReach 48

    OpenAI builds age prediction to filter ChatGPT for teens

    OpenAI just revealed it is building an age-prediction system to tell whether ChatGPT users are over or under 18, defaulting uncertain accounts to teen-safe settings. Parental controls are also arriving by the end of the month, letting parents link accounts, disable memory, and set blackout hours.

  12. IndustryReach 55

    Rolling Stone owner sues Google over AI summaries

    Penske Media, the publisher behind Rolling Stone and Variety, just sued Google for antitrust abuse over AI Overviews. The lawsuit claims Google forces publishers to feed its AI summaries, directly cannibalizing referral traffic and ad revenue with no opt-out short of leaving search entirely. Google fired back, calling the claims meritless.

  13. IndustryReach 42

    California passes SB 53 AI safety bill, but a veto still looms

    California lawmakers just passed SB 53, a major AI safety bill requiring large AI labs to disclose safety protocols and protect whistleblowers. It also sets up a public compute cloud called CalCompute, with stricter reporting rules for companies generating over $500 million in revenue. The bill now heads to Governor Gavin Newsom, who vetoed a similar bill last year.

  14. IndustryReach 36

    Tucker Carlson asks Sam Altman if he ordered a whistleblower's murder

    Tucker Carlson just confronted OpenAI CEO Sam Altman with a conspiracy theory claiming he ordered the murder of former researcher Suchir Balaji. Balaji had accused OpenAI of copyright violations before his death was ruled a suicide by police. Altman pushed back sharply, calling the accusation completely crazy.

  15. Open sourceReach 45

    Google drops VaultGemma, an LLM built to forget your secrets

    Google and DeepMind just open-sourced VaultGemma, a 1B-parameter model trained from scratch with differential privacy. By mathematically injecting noise into training, it ensures the model never memorizes sensitive sequences. While privacy constraints pull its benchmark performance back to roughly GPT-2 levels, it provides the first empirical scaling laws for provably private AI.

  16. IndustryReach 43

    California takes aim at AI companion chatbots with SB 243

    California lawmakers just passed SB 243, sending a bill to Governor Gavin Newsom that would hold AI companion bots like Character.AI and ChatGPT legally accountable for user safety. Platforms would have to block self-harm and explicit content, and ping minors every three hours reminding them their digital pal isn't human. Why it matters: If signed, California becomes the first state to regulate emotional AI, allowing users to sue platforms for up to $1,000 per violation.

  17. IndustryReach 52

    Microsoft and OpenAI ink MOU for next phase

    Microsoft and OpenAI just signed a non-binding memorandum of understanding to pave the way for the next phase of their partnership. The two companies are finalizing terms for a definitive agreement while reaffirming their shared commitment to safety.

  18. IndustryReach 42

    A new web standard forces AI bots to pay up

    Web giants like Reddit, Yahoo, and Medium just backed Really Simple Licensing (RSL), an open standard that lets site owners charge AI developers for scraping content. Built on robots.txt, the system allows publishers to set fees per crawl or per inference rather than just blocking bots outright. Why it matters: It attempts to give publishers collective leverage against Big Tech, though its success hinges entirely on AI companies playing by the rules.

  19. IndustryReach 35

    Geoffrey Hinton warns AI is about to unleash massive unemployment

    Geoffrey Hinton just warned that tech CEOs are deluding themselves about AI's rosy future. In an interview with the FT, the Nobel laureate said the wealthy will inevitably use AI to replace workers, creating massive joblessness and ballooning profits that a universal basic income cannot fix. He also bet that superintelligence will arrive within 5 to 20 years.