Skip to content
IFAI

On-device AI

Industry tag622 stories

  1. AI modelsReach 46

    Meta's open-source AI is blasting off to the ISS

    Meta and Booz Allen just launched a fine-tuned version of Llama 3.2 aboard the International Space Station. Dubbed "Space Llama," the multimodal system runs entirely offline on HPE space computers with Nvidia acceleration, slashing processing time from minutes to just over a second. Why it matters: It proves open-source edge AI can keep critical missions running in places where the cloud simply can't reach.

  2. Open sourceReach 44

    OpenAI's upcoming open model might call the cloud for backup

    OpenAI is reportedly planning a "handoff" feature for its upcoming open reasoning model, letting it ping larger cloud models when local queries get too tricky. The model is being trained from scratch for an early summer launch to challenge DeepSeek R1. It is a clever move that bridges open weights with OpenAI's paid API ecosystem.

  3. AI toolsReach 39

    Ray-Ban Meta glasses get offline live translation

    Meta just rolled out live translation to all Ray-Ban smart glasses users across supported markets. The feature enables real-time two-way translation between English, French, Italian, and Spanish—and by downloading language packs in advance, it works completely offline without Wi-Fi or cellular data. It turns the smart frames into a genuinely practical travel translator.

  4. AI toolsReach 39

    NVIDIA lets RTX owners build custom AI plugins

    NVIDIA just released the G-Assist Plug-In Builder alongside the experimental launch of Project G-Assist inside the NVIDIA app. Powered by a responsive local small language model running directly on RTX GPUs, the tool lets users create Python and JSON-based plugins to control hardware, trigger game guides, and connect external APIs. It gives PC gamers and creators a genuinely customizable, hands-free on-device copilot.

  5. Open sourceReach 54

    Google squeezes Gemma 3 onto consumer GPUs with new QAT models

    Google just released optimized versions of its Gemma 3 open models using Quantization-Aware Training (QAT). By simulating low-precision operations during training, the 4-bit (int4) weights cut memory demands drastically while slashing perplexity loss by 54%. This means developers can now run powerful 27B models locally on consumer cards like the NVIDIA RTX 3090 instead of expensive cloud clusters.

  6. Open sourceReach 42

    Stable Diffusion gets up to 3.8x faster on AMD chips

    Stability AI just teamed up with AMD to release ONNX-optimized versions of Stable Diffusion 3.5 and SDXL, engineered specifically for Radeon GPUs and Ryzen AI APUs. The new builds run up to 3.8x faster than standard PyTorch models while keeping full image quality intact. It is a major local AI performance win for AMD hardware users, ready to drop into ONNX Runtime workflows or Amuse 3.0.

  7. ResearchReach 32

    Google built an on-device AI to decode dolphin chatter

    Google just unveiled DolphinGemma, a ~400M parameter model developed with Georgia Tech and the Wild Dolphin Project to decode dolphin vocalizations. Operating audio-in and audio-out, it predicts upcoming call patterns much like an LLM predicts words. Best of all, it runs directly on Pixel phones in the wild, with an open-source release planned for summer 2025.

  8. AI toolsReach 34

    Apple's upgraded Siri might arrive this fall after all

    Apple is reportedly planning to roll out its delayed, smarter Siri features this fall rather than pushing them to 2026, according to The New York Times. The revamped assistant can handle complex actions like editing and sending photos on command, likely landing right alongside iOS 19. Why it matters: If Apple actually delivers this fall, it gives the company a fighting chance to prove it isn't completely falling behind Google and Meta in consumer AI.

  9. AI toolsReach 37

    Microsoft is finally rolling out Recall for real

    Microsoft just began rolling out its controversial Recall feature to Windows Insiders in the Release Preview ring, signaling an imminent wider launch. The tool continuously snapshots user activity on Copilot Plus PCs to make past actions searchable, but now requires explicit opt-in and lets users pause recording at any time. Reaching Release Preview is Microsoft's final milestone before shipping broadly to Windows 11.

  10. RoboticsReach 33

    Zoox starts mapping Los Angeles streets

    Amazon’s Zoox just deployed a fleet of retrofitted Toyota Highlanders in Los Angeles to collect mapping data ahead of broader autonomous testing this summer. While rival Waymo already offers paid rides in LA, this marks Zoox’s sixth test city as it inches toward public launches in Las Vegas and San Francisco later this year.

  11. Open sourceReach 68

    AudioX puts multimodal sound design on consumer GPUs

    AudioX just open-sourced an all-in-one audio model that runs locally at under 6GB. It generates sound effects and background music from text, images, or silent video—even matching cuts to scene transitions—while handling seamless audio inpainting and continuation.

  12. AI toolsReach 38

    Kindle brings spoiler-free recaps and in-book Q&A to readers

    Amazon just rolled out "Story So Far" and "Ask this Book" on Kindle to save readers from forgetting complex plots. The tools serve up catch-ups tailored strictly up to your current reading position and answer questions about characters on the fly without spoilers. It is currently available for U.S. users across thousands of popular English titles.

  13. IndustryReach 37

    Qualcomm buys VinAI's generative AI team

    Qualcomm just acquired the generative AI division of Vietnamese startup VinAI for an undisclosed sum. Led by former DeepMind researcher Hung Bui, the team builds computer vision algorithms and language models. Marking Qualcomm's second AI buyout this year after Edge Impulse, the move directly fuels its push into on-device AI across smartphones, PCs, and connected vehicles.

  14. AI toolsReach 37

    Microsoft expands Copilot Plus PC AI features to Intel and AMD

    Microsoft just rolled out its exclusive Copilot Plus PC features to Intel and AMD devices via the latest Windows 11 update. The update brings real-time Live Captions, Paint Cocreator, and Photos AI editing beyond Qualcomm chips. The widely discussed Recall feature, however, still lacks a general rollout date.

  15. Open sourceReach 51

    OpenAI is finally releasing an open-weight model

    OpenAI just announced plans to release its first open language model since GPT-2 in the coming months, launching a community survey to guide development. CEO Sam Altman revealed the model will pack o3-mini-level reasoning and run directly on your own hardware, marking a major strategy shift amid fierce heat from open-source rivals.

  16. AI toolsReach 34

    Apple Intelligence lands on Vision Pro with visionOS 2.4

    Apple just released visionOS 2.4, bringing Apple Intelligence to Vision Pro for the first time. Headset users get Writing Tools, Image Playground, Genmoji, and system-level ChatGPT integration right in spatial computing. It is rolling out in beta and requires device and Siri language set to U.S. English.

  17. IndustryReach 44

    Apple is reportedly building an AI doctor

    Apple is reportedly going full steam ahead on "Project Mulberry," an initiative to build an AI-powered doctor and an overhauled Health app. It is designed to turn device biometrics into personal medical advice and food tracking, with a potential rollout as early as 2026 in iOS 19.4.

  18. AI toolsReach 39

    Nvidia's new G-Assist AI runs right on your GPU to overclock your PC

    Nvidia just rolled out G-Assist, an experimental AI chatbot that runs locally on your GPU inside the Nvidia desktop app. It lets you monitor PC performance, tweak game settings, and even auto-overclock your graphics card through a floating overlay. Game integration is still sparse, but it's a neat preview of local AI hardware assistants.

  19. RoboticsReach 33

    Waymo takes its robotaxis to Washington, DC

    Waymo just announced plans to launch its Waymo One driverless ridehailing service in Washington, DC by 2026. The major roadblock is local law, which currently requires a human behind the wheel for testing and bans driverless commercial operations entirely. If regulators clear the way, the fleet—which already logs 200,000 paid rides weekly—will roll directly into the nation's capital.

  20. IndustryReach 35

    Apple sets WWDC 2025 dates for June 9

    Apple just announced that its annual Worldwide Developers Conference (WWDC25) will run online from June 9 to 13. The conference will be completely free for all developers and spotlight the next generation of Apple software, with a limited in-person event kicking off at Apple Park on opening day.