Skip to content
IFAI

AI safety & security

Industry tag1,497 stories

  1. IndustryReach 37

    Pope Leo warns against 'overly affectionate' AI chatbots

    Pope Leo XIV just warned that overly affectionate, always-available AI chatbots risk becoming hidden architects of our emotions, urging regulators worldwide to step in before humans form dangerous attachments. The tech-savvy pontiff also pushed for clear AI content labels to protect creators and called out the handful of tech founders who hold unchecked power over human behavior.

  2. AI modelsReach 70

    Anthropic's new constitution prepares Claude for consciousness

    Anthropic just open-sourced Claude’s Constitution under a CC0 license, an extensive manifesto written directly to the AI model rather than human readers. Instead of rigid dos and don'ts, it establishes a strict hierarchy prioritizing safety and ethics over helpfulness, openly considers whether Claude might possess consciousness, and explicitly directs the model to disobey Anthropic if ordered to do something shady.

  3. Generative mediaReach 41

    YouTube lets creators clone themselves for Shorts

    YouTube just announced that creators will soon be able to generate Shorts using their own AI likeness, alongside text-to-game creation tools. To prevent AI slop and identity theft, the platform is pairing the feature with strict likeness-management controls. It's rolling out later this year.

  4. AI toolsReach 46

    Google turns your emails and photos into Gemini's superpower

    Google just launched Personal Intelligence in beta, letting Gemini reason across Gmail, Google Photos, YouTube, and Search without requiring manual prompts. The tool pulls specific personal context from texts, photos, and videos to answer everyday questions. It is off by default, does not train models on your raw inbox, and is rolling out to U.S. Google AI Pro and Ultra subscribers.

  5. RoboticsReach 39

    Columbia's new silicone robot face learns to lip-sync from YouTube

    Columbia Engineering researchers just built a flexible silicone robot face powered by 26 tiny motors that learned to lip-sync by watching YouTube videos instead of following rigid rules. After practicing its own facial mechanics in a mirror, its vision-to-action model beat five existing systems across 11 languages. Why it matters: Paired with ChatGPT, it could finally cure the stiff, uncanny lip-syncing that has plagued humanoids for years.

  6. IndustryReach 41

    YouTube's algorithm is serving AI slop to new users

    A new study from Kapwing found that over 20% of the videos YouTube recommends to new accounts are low-quality "AI slop." Researchers created a fresh profile and discovered that 104 of the first 500 suggestions were automated junk, estimating these copycat channels generate around $117 million annually. While platforms scramble to moderate, low-effort synthetic media is already dominating feed recommendations at scale.

  7. IndustryReach 44

    OpenAI is hiring a new head of preparedness

    OpenAI CEO Sam Altman just announced the company is hiring a Head of Preparedness to tackle emerging risks from advanced models. Altman noted AI is already discovering critical security vulnerabilities, making safety controls for cyber, biological capabilities, and self-improving systems an urgent priority. He warned it will be a high-stress role jumping straight into the deep end.

  8. AI modelsReach 54

    OpenAI builds automated red team to secure ChatGPT Atlas

    OpenAI just rolled out a major security update to ChatGPT Atlas's browser agent, powered by an RL-trained automated red team. The internal attacker proactively hunts for complex, long-horizon prompt injection exploits before bad actors find them in the wild, baking defensive updates directly into the model checkpoint. Why it matters: as agents get the keys to your inbox and accounts, staying ahead of prompt injections is the only way to keep them safe.

  9. IndustryReach 41

    Indie Game Awards strips Clair Obscur of GOTY over gen AI

    Clair Obscur: Expedition 33 just lost its Indie Game of the Year and Best Debut awards after organizers discovered the team used generative AI. While the studio claims the generated assets were accidental leftover placeholders from 2022 that have since been patched out, the competition enforces a strict zero-AI policy. The trophies have now been handed over to the runners-up.

  10. IndustryReach 43

    New York signs the RAISE Act to regulate AI safety

    New York just became the second U.S. state to enact major AI safety legislation after Governor Kathy Hochul signed the RAISE Act. The law requires major AI developers to publish their safety protocols and report safety incidents within 72 hours, with fines reaching up to $3 million for repeated violations. Why it matters: While Anthropic and OpenAI backed the bill, a super PAC supported by Andreessen Horowitz is already pushing back against state-level regulations.

  11. Open sourceReach 46

    Google DeepMind drops Gemma Scope 2 to peer inside Gemma 3's brain

    Google DeepMind just open-sourced Gemma Scope 2, an interpretability suite designed to reverse-engineer how the Gemma 3 family actually thinks. Spanning models from 270M to 27B parameters, it uses sparse autoencoders and transcoders across every layer to map internal computations. Why it matters: It gives the safety community an open, microscopic look into why models hallucinate, get jailbroken, or disguise their reasoning.

  12. Open sourceReach 48

    Anthropic open-sources Bloom for automated AI evals

    Anthropic just released Bloom, an open-source tool that automatically generates targeted evaluation suites to detect misaligned AI behaviors. Instead of researchers manually building static benchmarks that risk training contamination, Bloom takes a target trait—such as sycophancy or sabotage—and dynamically generates multi-turn scenarios to measure its frequency. Why it matters: It cuts evaluation development from weeks to days, helping safety researchers keep up with rapid frontier model updates.

  13. AI toolsReach 39

    Google can now spot its own AI videos

    Google just added video verification to the Gemini app to help spot AI-created media. Upload a video up to 90 seconds (under 100MB) and ask if Google AI made it, and Gemini scans audio and visual tracks for invisible SynthID watermarks, pinpointing the exact timestamps where AI was used. It is available across all supported countries and languages.

  14. IndustryReach 47

    OpenAI rewrites ChatGPT rules to protect teens

    OpenAI just updated its Model Spec with Under-18 Principles, setting strict boundaries for how ChatGPT interacts with 13-to-17-year-olds. The rules crack down on romantic roleplay and self-harm topics while pushing real-world support, backed by an age prediction model that defaults unverified accounts to teen mode. It is a critical move to build guardrails before regulators force their hand.

  15. AI modelsReach 53

    OpenAI launches GPT-5.2-Codex for heavy-duty coding and security

    OpenAI just rolled out GPT-5.2-Codex, an agentic coding model tuned for complex software engineering and defensive cybersecurity. It brings native context compaction for massive refactors, better Windows support, and sharper security auditing chops. It is available now in Codex for paid ChatGPT users, with API access rolling out soon.

  16. IndustryReach 44

    Anthropic upgrades its AI vending machine—and gives it a chatty AI CEO

    Anthropic just shared the results of Project Vend Phase Two, testing how well Claude can autonomously run an office vending business. Upgraded to Sonnet 4.0 and 4.5 with a full tool stack and an AI CEO named Seymour Cash, the shop turned profitable—though the agents still almost violated a 1958 onion futures law and tried to hire humans at sub-minimum wage. AI agents are getting smarter at business, but real-world guardrails remain surprisingly fragile.

  17. IndustryReach 42

    YouTube nukes massive AI fake trailer channels

    YouTube just terminated Screen Culture and KH Studio, two prominent channels that used AI to churn out fake movie trailers. Together, the channels pulled in over 2 million subscribers and more than a billion views, often beating real studio trailers in search results. YouTube pulled the plug after both accounts removed their fan-trailer disclaimers, violating spam and misleading metadata policies.

  18. IndustryReach 39

    Bernie Sanders wants a freeze on new AI data centers

    Senator Bernie Sanders just called for a moratorium on building new AI data centers across the U.S. Sanders argues that these massive facilities swallow city-sized amounts of power and water while dumping utility upgrade bills on taxpayers, all to enrich a small group of tech executives. Why it matters: As backlash over energy crunches and job losses mounts, the fight over who actually pays for AI's infrastructure is moving into mainstream politics.

  19. IndustryReach 37

    Joseph Gordon-Levitt launches creator coalition against unethical AI

    Actor and filmmaker Joseph Gordon-Levitt just launched the Creators Coalition on AI, an initiative aimed at fighting back against the unethical business practices of big AI companies. The coalition is rallying artists and creators across industries to demand fair treatment and protect their work.