Skip to content
IFAI

AI safety & security

Industry tag1,497 stories

  1. IndustryReach 64

    Anthropic and Palantir bring Claude to U.S. defense agencies

    Anthropic and Palantir just teamed up with AWS to deliver Claude 3 and 3.5 to U.S. intelligence and defense agencies. The setup runs within Palantir's AIP hosted on its Impact Level 6 accredited environment, helping officials quickly analyze complex intelligence data. It marks Claude's first deployment into classified government operations.

  2. IndustryReach 38

    What Trump’s win means for the future of AI regulation

    Donald Trump is returning to the White House, and his victory could dismantle the Biden administration's AI policy framework. Trump previously pledged to cancel Biden's sweeping AI executive order on "day one," which would erase federal safety and reporting mandates for top AI developers. While federal oversight looks set to loosen, aggressive trade tariffs and state-level laws could still create major headaches for tech firms.

  3. IndustryReach 51

    What Trump's victory means for AI regulation

    Donald Trump just secured a second term, and his team is poised to dismantle Biden’s landmark AI executive order on day one. A rollback would eliminate mandatory safety testing disclosures for frontier models, signaling a pivot toward light-touch federal regulation alongside aggressive chip export controls.

  4. IndustryReach 33

    AI safety advocates tell startup founders to pump the brakes

    AI safety experts just urged startup founders at TechCrunch Disrupt to ditch the move-fast mindset and prioritize red-teaming. Prompted by Character.AI's recent lawsuit and escalating copyright concerns, speakers warned that rushing products to market without guardrails risks severe real-world harm.

  5. AI modelsReach 57

    Meta opens Llama AI models to U.S. military

    Meta just made an exception to its military ban, allowing U.S. defense and national security agencies to use its Llama models. Partners like Lockheed Martin and Oracle are already tapping the AI for code generation and aircraft maintenance. Meta is also extending access to government partners in the U.K., Canada, Australia, and New Zealand.

  6. IndustryReach 44

    Instagram will use AI to catch teens lying about their age

    Meta plans to roll out an "adult classifier" AI on Instagram in early 2025 to flag underage users who lie about their age and automatically place them into restricted teen accounts. The tool analyzes behavioral data, follower lists, and even friends' "happy birthday" posts to estimate age. Why it matters: Online age verification has long relied on the honor system; Meta is now turning to behavioral AI surveillance under intense regulatory pressure.

  7. IndustryReach 52

    Microsoft delays controversial Recall AI feature again

    Microsoft just pushed back the rollout of its controversial Recall feature for Copilot Plus PCs to December, missing its revised October preview target. The company says it needs extra time to overhaul security, making the local snapshot tool strictly opt-in, fully uninstallable, and protected by Windows Hello authentication.

  8. AI toolsReach 52

    ElevenLabs turns X profiles into custom AI voices

    ElevenLabs just rolled out an open-source project called X to Voice alongside a new Voice Design API. The tool scans any X profile's bio and posts to craft a prompt, generating three unique voice previews and even animating profile pictures with matching lip movements. Developers can now also build custom voices for their AI characters via the API.

  9. ResearchReach 35

    OpenAI's SimpleQA puts AI honesty to the test

    OpenAI just open-sourced SimpleQA, a factual accuracy benchmark packed with 4,326 short, single-answer questions built to expose hallucinations. Frontier models like GPT-4o struggle hard, scoring under 40% correct. Why it matters: Measuring how often models fabricate answers—and how persistently they overstate their confidence—is the first concrete step toward fixing AI's chronic guessing problem.

  10. AI toolsReach 40

    OpenAI's Whisper caught hallucinating in up to 80% of transcripts

    Researchers just revealed that OpenAI’s Whisper transcription model frequently hallucinates, with a University of Michigan study finding fabricated text in 80% of reviewed transcripts. Other engineers found widespread inventions, including fictional medical treatments. Why it matters: Whisper is already widely deployed across medical consultations and enterprise cloud platforms.

  11. AI toolsReach 34

    Microsoft confirms Recall is not secretly on your PC

    Microsoft just pushed back against viral rumors claiming its controversial Recall AI feature is secretly being installed on Windows 11 24H2. The company reiterated that Recall remains strictly opt-in and fully uninstallable, with experts noting that recent system references are actually stubs meant to make removal easier for admins. Why it matters: After months of privacy pushback, users are on edge, and Microsoft is still working to rebuild trust before its delayed preview rollout.

  12. Open sourceReach 49

    OSI drops official open source AI definition (and Llama doesn't count)

    The Open Source Initiative just launched version 1.0 of its Open Source AI Definition. To qualify, models must share complete training code and detailed data provenance without restrictive commercial caps, effectively disqualifying Meta's Llama. Why it matters: regulators and developers now have a strict standard to call out open-washing.

  13. Generative mediaReach 47

    Universal Music taps AI startup KLAY for ethical tunes

    Universal Music Group just partnered with AI startup KLAY to build an ethical foundational music model called KLayMM. KLAY, led by music industry and DeepMind veterans, promises not to compete with artists' catalogs while ensuring accurate attribution. It is UMG's latest push to legitimize commercial AI music on its own terms.

  14. IndustryReach 39

    Redditors troll Google's AI with fake restaurant tips

    Redditors in London are purposefully sharing fake restaurant recommendations to keep tourists and influencers away, tricking Google’s AI Overviews into serving bogus answers. The grassroots misinformation campaign highlights a glaring flaw in search engines relying on scraped user forums for factual summaries.

  15. IndustryReach 42

    Judge halts California's election deepfake ban

    A federal judge just temporarily blocked California from enforcing its new AI deepfake law, AB 2839, which targeted users distributing deceptive political content. The ruling followed a lawsuit over an AI parody of Kamala Harris that Elon Musk reposted, with the court deciding the statute is too broad and threatens political satire. Why it matters: The injunction stops the state's crackdown on election deepfakes just weeks before voters cast their ballots.

  16. IndustryReach 44

    Harvard students turn Meta's smart glasses into a real-time doxxing tool

    Two Harvard students just demonstrated how easily smart glasses can become surveillance tools by linking Ray-Ban Meta glasses with public facial recognition engines and LLMs. The project, dubbed I-XRAY, pulls strangers' names, phone numbers, and home addresses in seconds. They aren't releasing the code, framing the demo as an urgent wake-up call.

  17. IndustryReach 40

    Famous AI artist sues US Copyright Office over Midjourney painting

    Jason M. Allen, the creator who sparked backlash in 2022 for winning an art contest with a Midjourney image, is now suing the U.S. Copyright Office after it rejected his registration. Allen claims copycats are ripping off 'Théâtre D’opéra Spatial' on OpenSea and Etsy, arguing his extensive prompting and Photoshop edits count as human authorship.

  18. IndustryReach 42

    Anthropic poaches another OpenAI co-founder

    OpenAI co-founder Durk Kingma just announced he is joining Anthropic to focus on responsible AI development from the Netherlands. Kingma previously led generative AI algorithm research at OpenAI before a stint at Google Brain. The move marks another major talent win for Anthropic following the recent arrivals of Jan Leike and John Schulman.

  19. AI toolsReach 38

    Microsoft packs Copilot+ PCs with Click to Do and a reworked Recall

    Microsoft just introduced a fresh suite of on-device AI experiences for Copilot+ PCs and Windows 11. Highlights include Click to Do, an interactive overlay suggesting quick actions across any screen, alongside offline natural language file search and 8x photo upscaling. Recall also returns with opt-in defaults and biometric locks, rolling out to Windows Insiders this fall.