Skip to content
IFAI

AI safety & security

Industry tag1,497 stories

  1. IndustryReach 45

    ByteDance caught using OpenAI tech to train its rival LLM

    ByteDance just got caught secretly using OpenAI’s API to build and evaluate its competing foundation model, codenamed Project Seed, in direct violation of OpenAI's terms of service. Internal Lark chats reportedly revealed staff discussing how to "whitewash" the data trails, prompting OpenAI to quickly suspend ByteDance's account pending investigation. Why it matters: While smaller startups often risk using GPT outputs to bootstrap, seeing a tech giant of ByteDance’s scale cut corners highlights the extreme pressure to catch up in the generative AI race.

  2. ResearchReach 35

    OpenAI drops $10M to tame superhuman AI

    OpenAI just launched a $10M Superalignment Fast Grants program in partnership with Eric Schmidt to fund research into aligning superhuman AI systems. The initiative offers grants from $100K to $2M alongside $150K graduate fellowships, prioritizing weak-to-strong generalization, interpretability, and scalable oversight—with no prior alignment experience required.

  3. Generative mediaReach 31

    Google's new MusicFX turns text prompts into tunes

    Google just launched MusicFX, an experimental tool that whips up custom music tracks from simple text prompts. Powered by MusicLM, the tool bakes DeepMind's SynthID watermarks directly into the audio to flag AI origin. To steer clear of legal trouble, it outright refuses to generate vocals or mimic specific artists. It is rolling out first to users in the US, Australia, New Zealand, and Kenya.

  4. IndustryReach 34

    Sam Altman opens up on OpenAI drama and AGI risks

    OpenAI CEO Sam Altman just gave a wide-ranging interview after being named TIME's CEO of the Year, discussing his brief ouster, AI governance, and the road to AGI. Altman called AGI humanity’s most powerful technology yet, admitting he feels far more pressure about steering superintelligence and countering election disinformation than boardroom politics.

  5. IndustryReach 39

    The U.S. government is going all-in on AI without a plan

    The U.S. Government Accountability Office (GAO) just warned that federal agencies are rapidly adopting AI across hundreds of use cases without unified safety and procurement standards. While agencies already use AI in over 200 operations, oversight officials found that regulatory guidelines are years behind schedule. Why it matters: Rushing deployment without shared rules leaves sensitive tools like facial recognition wide open to security gaps and civil liberties abuses.

  6. IndustryReach 31

    FTC weighs antitrust probe into Microsoft's OpenAI deal

    The US Federal Trade Commission is reportedly considering an antitrust investigation into Microsoft's multi-billion-dollar investment in OpenAI. Microsoft has poured over $10 billion into the AI startup, though it insists it owns no actual equity and only holds profit share rights. Following a similar move by the UK's CMA, regulators are increasingly scrutinizing the alliance.

  7. AI modelsReach 68

    YouTuber recreates Google's faked Gemini demo with GPT-4V

    A developer just rebuilt Google's heavily edited Gemini video demo using OpenAI's GPT-4V to prove real-time multimodal interaction is already possible. The custom setup correctly handled hand gestures, live drawings, and rock-paper-scissors in real time, with the open-source code now shared on GitHub.

  8. AI modelsReach 51

    Elon's Grok caught quoting OpenAI's policy

    xAI's flagship bot Grok was caught denying user requests by stating it violates OpenAI's use case policy, an awkward slip for Elon Musk's rival AI. While xAI claimed the bot merely swept up ChatGPT outputs during web scraping, researchers suspect it was fine-tuned on synthetic OpenAI data.

  9. IndustryReach 43

    Your fast-food ‘AI’ drive-thru is actually humans in disguise

    Presto Automation pitched its AI drive-thru tech to major fast-food chains like Del Taco and Carl's Jr. as a labor-saving miracle, but SEC filings just revealed a wild reality: over 70% of orders are actually completed by human workers in the Philippines. The SEC has launched an investigation into the startup. Why it matters: It exposes an ongoing trend of companies rebranding low-cost offshore contractor work as magical artificial intelligence.

  10. IndustryReach 44

    Europe agrees on world's first comprehensive AI Act

    EU negotiators just clinched a provisional deal on the Artificial Intelligence Act, setting the world's first comprehensive rules for AI. The legislation bans high-risk applications like social scoring and workplace emotion recognition, sets transparency guardrails for powerful foundation models, and introduces fines up to 7% of global annual turnover.

  11. Open sourceReach 47

    Meta launches Purple Llama to secure open AI

    Meta just launched Purple Llama, an umbrella initiative aimed at standardizing trust and safety for open generative AI models. The initial release delivers the industry's first shared cybersecurity evaluation benchmarks alongside Llama Guard, an openly available foundational model designed to filter risky inputs and outputs for research and commercial applications.

  12. Generative mediaReach 50

    Meta just launched a standalone AI image generator

    Meta just rolled out Imagine with Meta, a standalone web-based image generator powered by its Emu model. U.S. users can now generate four high-resolution images per text prompt for free without jumping into a messaging app. Meta also pledged to add invisible AI watermarks that survive cropping and compression to boost transparency.

  13. IndustryReach 34

    Mozilla wants to save AI like it saved the web

    Mozilla just released its State of Mozilla report, outlining a major push to steer AI in an open, human-centered direction just as it did with Firefox for the early web. The foundation is assembling a coalition of open-source developers and startups to counter Big Tech control. Why it matters: Mozilla wants to ensure the future internet stays decentralized.

  14. IndustryReach 44

    Chinese court grants copyright to AI-generated images

    A Chinese court just ruled that AI-generated images are entitled to copyright protection if they reflect human originality and creative input. The Beijing Internet Court stated that setting prompts, tuning parameters, and curating outputs is fundamentally creating with tools—marking a sharp contrast with Western rulings that reject AI copyrights.

  15. Generative mediaReach 38

    Amazon enters AI image race with Titan

    Amazon just launched its Titan Image Generator for enterprise developers via AWS Bedrock. The model creates studio-quality images, swaps backgrounds, and automatically embeds invisible watermarks that survive cropping and compression. To sweeten the deal for cautious enterprises, Amazon is also offering full copyright indemnity.

  16. IndustryReach 55

    Sam Altman is officially back as OpenAI CEO

    Sam Altman just officially returned as CEO of OpenAI alongside Greg Brockman and Mira Murati, closing out days of unprecedented corporate turmoil. The company established a new initial board chaired by Bret Taylor, with Larry Summers joining and Microsoft securing a non-voting observer seat. Why it matters: OpenAI dodged an existential collapse, but now must overhaul its fragile governance structure.

  17. IndustryReach 47

    Pentagon fast-tracks thousands of autonomous drones as lethal AI looms

    The Pentagon is pushing to field thousands of cheap, AI-enabled autonomous drones by 2026 under its Replicator initiative to counter China. While officials maintain humans will stay in the loop, experts warn rapid machine speeds mean fully autonomous lethal weapons are quickly becoming an inevitable reality.

  18. IndustryReach 52

    18 countries ink pact to make AI 'secure by design'

    The US, Britain, and 16 other nations just unveiled a 20-page international agreement urging tech companies to build AI that is 'secure by design.' The non-binding guidelines call for vetting software vendors, monitoring abuse, and running security tests before release—a first step toward prioritizing defense over speed to market.

  19. IndustryReach 44

    A mystery letter about Q* may have sparked OpenAI's chaos

    Reuters reported that just before Sam Altman was briefly ousted, OpenAI researchers sent the board a warning letter about a potent AI discovery dubbed Q* that could threaten humanity. The model reportedly solved certain grade-school math problems under heavy compute, fueling internal hopes for AGI—and handing the board a key catalyst for Altman's dramatic dismissal.

  20. IndustryReach 58

    Sam Altman returns as OpenAI CEO

    Sam Altman is officially returning to OpenAI as CEO, ending a chaotic five-day boardroom coup. Co-founder Greg Brockman is coming back as well, alongside a freshly overhauled board featuring Bret Taylor and Larry Summers. The dramatic reversal follows intense employee revolt and investor pressure, with both sides agreeing to an independent investigation into the whole saga.