Skip to content
IFAI

On-device AI

Industry tag621 stories

  1. Open sourceReach 48

    Gradium drops phonon-31m-en: a 64.5 MB local TTS that runs inside browser tabs

    Gradium just released phonon-31m-en, a lightweight English text-to-speech model built on Pocket TTS and Kyutai's Mimi codec. Weighing just 64.5 MB in 8-bit quantization, it streams natural 24 kHz speech entirely on-device across laptops, smartphones, and web browsers under the Apache 2.0 license. Why it matters: offline, zero-latency voice agents just became dirt cheap to deploy anywhere.

  2. Open sourceReach 48

    ISTA-DASLab fits 763B DeepSeek-V4.1 onto a 12GB GPU

    ISTA-DASLab just released non-uniform GSQ-RCO GGUF quantizations for DeepSeek-V4.1-Flash-1017, compressing the 763B MoE down to as low as 1.75 bpw. Paired with the Strata inference engine, the massive model runs on a single consumer 12GB GPU while the 2.00 bpw build retains 100% of the base model's task performance. Why it matters: Running frontier-tier open models locally no longer requires a server rack.

  3. Open sourceReach 49

    Tencent open-sources WeVisOne-VL for all-in-one vision tasks

    Tencent's WeChat Vision Team just open-sourced WeVisOne-VL, an all-in-one vision model in 2B and 4B sizes that unifies detection, counting, OCR, and matting. It ditches heavy external segmentation models like SAM in favor of a tiny 9.6M-parameter decoder, generating hair-level alpha mattes while reliably rejecting absent targets. Weights and code are out under Apache 2.0.

  4. Open sourceReach 48

    Tencent drops Hy-Nomas, an interactive world model that runs on a 4090

    Tencent just open-sourced Hy-Nomas, an interactive world generation model that turns natural language and camera trajectories into 720p virtual environments. By generating short chunks with persistent memory, it keeps scenes consistent for over a minute, and a 9GB distilled version runs locally on a single consumer GPU under Apache 2.0. Why it matters: It brings real-time interactive video down from datacenter clusters to individual creators and robotics researchers.

  5. Open sourceReach 59

    Underdog drops Bark 3.0: A 163MB speech model that beats Whisper Large

    Underdog just launched Bark 3.0 on Hugging Face, a tiny 163MB speech-to-text model that transcribes five minutes of audio in half a second on Apple Silicon. It outperforms Whisper Large on English meetings and even includes a Clean version that filters out filler words automatically. The main catch: it only supports English.

  6. AI toolsReach 53

    Perplexity Computer goes fully local on Mac

    Perplexity just launched a fully local version of Computer for Mac, letting Pro, Max, and Enterprise users run AI models and agentic workflows completely on Apple silicon. The local setup runs Qwen 3.6 or PPLX Pro to orchestrate tasks across Notes, Mail, and local files without pinging the cloud. It turns powerful Macs into private personal operating systems, though it recommends 36 GB or more of RAM.

  7. Open sourceReach 48

    GaussiAnimate open-sources flexible 3D character rigging

    Researchers just open-sourced GaussiAnimate, an animation tool that tackles tricky soft-body deformations in garments and animals. Instead of relying solely on a rigid skeleton, it pairs an inner bone structure for motion with flexible outer surface bones to handle complex bends and folds. Why it matters: It removes one of the biggest bottlenecks in 3D character rigging.

  8. Open sourceReach 48

    Ant Group open-sources Ming 3.0 TTS

    Ant Group just open-sourced Ming 3.0 TTS, a text-to-speech model family that lets you steer voice performance with natural-language prompts, inline emotion tags, or audio clones. It comes in 3GB and 18GB variants under an MIT license, with the lightweight version running smoothly on consumer GPUs.

  9. IndustryReach 41

    Rivian is bringing Claude and third-party AI agents to its EVs

    Rivian plans to integrate third-party AI agents from Anthropic, OpenAI, and Meta into its electric vehicles, CEO RJ Scaringe revealed at TechCrunch Disrupt. Powered by a proprietary framework that routes voice prompts between edge and cloud models, the car can pull personal context from other devices to plan dinners or schedules. Crucially, Scaringe stressed hard guardrails: AI agents will never control the steering or brakes.

  10. Open sourceReach 61

    NVIDIA launches high-speed Nemotron models for agentic AI

    NVIDIA just introduced three new open models in its Nemotron 3.5 family, spanning data centers to edge hardware. The flagship 120B Super VL delivers frontier multimodal accuracy at 5x the throughput of rivals, while the Bolt 74B-A9B fits inside 24GB of memory using native 2-bit quantization for local tasks. It brings enterprise-grade agentic workflows directly to on-premises rigs and laptops.

  11. Open sourceReach 60

    FLUX 3 Image Klein packs 4K generation into a 5.6B model

    Black Forest Labs just open-sourced FLUX 3 Image Klein, a compact 5.6B parameter model delivering native 4K text-to-image and pixel-perfect editing. Thanks to NVIDIA-optimized INT8 weights, it squeezes onto local GPUs with 8GB memory, making high-end local generation fast and accessible.

  12. Open sourceReach 72

    Meta's 816B open model runs on two Mac Studios

    Meta just dropped Muse Spark Open, an open-weight model with 816B total parameters (42B active) and a 1M-token context window designed for coding and agentic tasks. Leveraging the MLX framework, it is the first model in its class capable of running locally on two Apple M5 Ultra Mac Studios. Why it matters: massive agentic supercomputing no longer requires a cloud cluster.

  13. Open sourceReach 48

    InfiniSplat v2 turns multi-view photos into explorable 3D worlds

    Researchers just open-sourced InfiniSplat v2, a feed-forward 3D reconstruction model that turns multi-view photos or long driving videos into fully explorable 3D scenes. By decoupling geometry from appearance prediction, it cuts rendering errors and suppresses noisy artifacts. The entire model weighs around 6.6GB and runs locally on consumer GPUs.

  14. IndustryReach 44

    Google DeepMind brings on-device Gemma to fight conversational scams

    Google DeepMind just teamed up with GovTech Singapore to deploy a fine-tuned, on-device Gemma model that spots social engineering scams directly on smartphones. It uses a lightweight two-stage pipeline to analyze multi-turn conversations locally without sending raw messages to the cloud. Why it matters: conversational scams cause up to 80% of local scam losses, and edge AI proves platforms can protect users without compromising end-to-end encryption.

  15. IndustryReach 39

    Flox's edge AI is scaring bears off train tracks

    Flox Intelligence just deployed about 150 battery-powered edge devices across North America, Europe, and Australia to keep wildlife off train tracks and airport runways. The hardware uses on-device computer vision to identify animals and play species-specific sounds to prevent habituation. Train giant Alstom has signed on as an OEM partner as the startup opens a Series A round.

  16. IndustryReach 71

    Apple just dropped its first smart display

    Apple just unveiled HomeView, a $299 smart display powered by Siri AI and an A18 chip designed to replace your phone around the house. It features a 7-inch square screen that uses facial recognition to keep private texts and calendar events hidden until the right user walks up. Preorders are open now across eight countries ahead of a November 13th launch.

  17. IndustryReach 45

    Apple puts conversational Siri AI and the A19 chip into Apple TV 4K

    Apple just announced the fourth-generation Apple TV 4K, upgrading its living room box with Siri AI and an A19 chip. Built-in far-field microphones enable hands-free voice control, while Apple Intelligence generates smart home camera summaries directly on the big screen. It also supports a new four-speaker surround sound setup with HomePods.

  18. Open sourceReach 48

    Skywork's Matrix Game 4.0 runs real-time 3D games at 83 fps

    Skywork just open-sourced Matrix Game 4.0, an AI world model that generates playable 3D games in real time. Instead of hallucinating everything from scratch, it offloads physics to a traditional game engine and uses AI to rerender low-poly frames at up to 83 fps on a single consumer GPU, complete with an agent that edits gameplay code on the fly. Why it matters: it solves the visual warping that plagued earlier AI games, proving hybrid neural rendering actually works.

  19. ResearchReach 48

    Anthropic warns AI worms could soon spread across smart TVs

    Anthropic researchers just warned that small AI models are months away from autonomously self-replicating across IoT devices like smart ovens and TV boxes without datacenters. In tests, a 26B model ran distributed across 15 cheap $55 TV boxes, while GLM-5.2 achieved full end-to-end replication. Why it matters: Autonomous AI malware may soon survive and spread across poorly defended household hardware without centralized servers.

  20. AI toolsReach 43

    Google’s new Mac app transcribes meetings completely offline

    Google just released Google AI Edge Foresight, a free experimental note-taking app that transcribes meetings entirely offline on Apple Silicon Macs. Powered by its on-device EmbeddingGemma 2 model, the tool turns shorthand bullet points into polished notes and lets you query your meeting audio and local files. Best of all, none of your private data ever leaves your computer.