Skip to content
IFAI

On-device AI

Industry tag622 stories

  1. Open sourceReach 48

    Clawdbot turns messaging apps into full computer controllers

    Clawdbot (now Moltbot) just went viral as an open-source, self-hosted AI assistant that lets you control your local computer through Telegram or WhatsApp. It can run scripts, manage files, and even write its own code to build new skills without sending private data to the cloud.

  2. Open sourceReach 59

    Voicebox: an open-source local voice studio for cloning and dictation

    Open-source local voice tool Voicebox combines instant voice cloning with system-wide dictation, racking up over 42,000 GitHub stars. It can clone voices from a few seconds of audio, type into any text field via global hotkeys, and voice coding agents like Claude Code. Basically, it lets you ditch paid voice subscriptions and run your entire workflow locally.

  3. AI toolsReach 41

    Adobe drops on-device AI masking in Premiere

    Adobe just launched an on-device AI Object Mask tool for Premiere, letting editors track complex moving subjects with a simple hover and click. Redesigned shape masks track up to 20x faster, and editors can directly import assets from Firefly Boards. After Effects 26.0 also launched with native 3D parametric meshes and variable font animation.

  4. Open sourceReach 48

    Overworld open-sources real-time playable world model Waypoint-1

    Overworld just dropped Waypoint-1, an interactive video diffusion model you can explore in real time using a keyboard and mouse. Powered by its new WorldEngine inference library, the 2.3B model hits up to 60 FPS on an RTX 5090 with near-zero control lag. Visual consistency and hallucinations are still rough around the edges, but you can already test the demo or run it locally.

  5. Open sourceReach 48

    LightOn drops a tiny 1B OCR model that beats 9B giants

    LightOn just open-sourced LightOnOCR-2-1B, an Apache 2.0 end-to-end vision-language model that turns PDFs and scans into clean text without multi-stage pipelines. Despite its tiny 1B footprint, it beats Chandra-9B on OlmOCR-Bench and runs 1.73x faster than DeepSeekOCR. The release also includes bounding-box variants and a massive 16M-page training dataset.

  6. Open sourceReach 48

    Black Forest Labs drops sub-second FLUX.2 [klein]

    Black Forest Labs just launched FLUX.2 [klein], a speedy image generation family claiming sub-second inference that beats rival models by over 30%. It arrives in 4B and 9B variants, with the lightweight 4B edition released under a permissive Apache 2.0 license runnable on 8.4GB of VRAM.

  7. Open sourceReach 48

    Kyutai's Pocket TTS runs voice generation on pure CPU

    Kyutai just open-sourced Pocket TTS, a lightweight 100M-parameter text-to-speech model built to run entirely on CPUs without GPUs. It clocks in at roughly 6x real-time on a MacBook Air M4 with a 200ms time-to-first-audio latency, bringing voice cloning and infinite text streaming straight to consumer hardware.

  8. AI toolsReach 64

    Anthropic launches Claude Cowork: Claude Code for the rest of us

    Anthropic just released Claude Cowork in research preview, bringing the autonomous power of Claude Code to everyday knowledge work like organizing folders, crunching expenses, and drafting reports. It runs directly inside folders you choose and keeps working even after you close your laptop, though it is currently limited to Max subscribers on the macOS desktop app.

  9. Open sourceReach 48

    NovaSR: A 52KB audio model running 3,500x faster than real-time

    Developer yatharthsharma3501 just open-sourced NovaSR, a microscopic 52KB audio upsampler that turns muffled 16kHz recordings into crisp 48kHz sound. Built with under 10 Conv1D layers, it clocks in at 3,600x real-time speed on a single A100 with virtually zero compute overhead. It makes on-device speech cleanup and instant TTS enhancement dirt cheap.

  10. Open sourceReach 57

    Liquid AI dropped an experimental 3B model that punches way above its weight

    Liquid AI just rolled out LFM2-2.6B-Exp, an experimental checkpoint built entirely with pure reinforcement learning. Despite its 2.6B size, it outperforms competing 3B models across instruction, knowledge, and math benchmarks, even topping DeepSeek R1-0528 on IFBench despite being 263 times smaller. The weights are already live on Hugging Face.

  11. RoboticsReach 49

    Waymo’s robotaxis freeze up in SF blackout

    Waymo just had to temporarily suspend its ride-hailing fleet after a massive San Francisco power outage left autonomous SUVs stranded across city streets. The blackout knocked out traffic lights and choked cellular bandwidth, leaving vehicles unable to reach human remote operators for guidance. The incident highlights how fragile autonomous fleets remain when the basic utility grid goes dark.

  12. AI modelsReach 49

    Google unveils T5Gemma 2 with multimodality and 128K context

    Google just launched T5Gemma 2, an encoder-decoder model family built on Gemma 3 that introduces multimodal vision and massive 128K token contexts. By tying embeddings and merging attention mechanisms, Google squeezed parameters down to compact sizes (~370M to ~7B) ideal for on-device deployment. It is available as pre-trained weights ready for downstream fine-tuning.

  13. AI modelsReach 51

    Google launches FunctionGemma for on-device tool use

    Google just released FunctionGemma, a lightweight model tuned from Gemma 3 270M specifically for on-device function calling. Small enough to run locally on phones and Jetson Nano boards, fine-tuning boosts its task accuracy from 58% to 85%. Why it matters: It turns edge devices into fast, fully private agents capable of triggering native actions without touching the cloud.

  14. IndustryReach 39

    Nvidia brings 72GB of Blackwell GPU power to desktops

    Nvidia just made its RTX PRO 5000 72GB Blackwell GPU generally available for desktop workstations. The new card features 72GB of GDDR7 memory—a 50% increase over the 48GB variant—and delivers 2,142 TOPS of AI compute to handle memory-heavy agentic and generative workloads. Why it matters: Developers can now prototype and run tool-using AI agents directly from a local workstation without relying entirely on expensive data-center infrastructure.

  15. AI toolsReach 33

    Rivian rolls out Universal Hands-Free across 3.5M miles

    Rivian just released its 2025.46 software update, expanding hands-free assisted driving for Gen 2 vehicles from 135,000 miles to over 3.5 million miles across the US and Canada. The update also brings Autonomy Drive Styles powered by end-to-end AI models, allowing drivers to choose between Mild, Medium, and Spicy behavior on the road. Why it matters: Hands-free highway driving is quickly moving to everyday surface streets with personality settings to match human preferences.

  16. IndustryReach 33

    Rivian builds its own silicon for next-gen autonomous driving

    Rivian just revealed custom silicon and a next-generation autonomy platform built for deep vehicle AI integration. The automaker showcased its Universal Hands Free capability, aiming to roll out hands-off and eyes-off driving under controlled conditions on second-generation models in 2026.

  17. AI toolsReach 34

    World's smallest AI supercomputer fits in your pocket

    Tiiny AI just unveiled the Pocket Lab, officially certified by Guinness as the world’s smallest personal AI supercomputer. Sized like a power bank and sipping just 65W, it runs 120B-parameter LLMs completely offline without high-end GPUs, using sparse activation and the open-source Powerinfer engine to put local intelligence in your pocket.

  18. Open sourceReach 60

    Mistral drops Devstral 2 coding model and Vibe CLI

    Mistral AI just released Devstral 2, a lightweight open-weights coding model family led by a 123B flagship and a 24B small version. The larger model scores 72.2% on SWE-bench Verified at up to 7x the cost efficiency of Claude Sonnet, while the 24B version runs locally on consumer hardware. The release also includes Mistral Vibe, an open-source terminal CLI for autonomous software development.