Skip to content
IFAI

On-device AI

Industry tag622 stories

  1. IndustryReach 44

    Apple's new M6 and M5 Ultra bring frontier AI to the desk

    Apple just unveiled its first 2nm chip, the M6, alongside the powerhouse M5 Ultra for the new Mac mini and Mac Studio. The M6 features a Dual 16-core Neural Engine for 2x AI compute, while the quad-die M5 Ultra packs up to 512GB unified memory and 1.2TB/s bandwidth to run massive frontier models directly on-device.

  2. AI toolsReach 39

    Perplexity builds a local-first AI agent that keeps secrets on your desk

    Perplexity just introduced Computer, a local-first agent framework designed to run compact models like Qwen directly on user hardware. By default, conversations, trajectory, and tool execution stay completely on-device in an OS-level sandbox, cutting API token costs to zero. When a problem gets too tough, it asks permission to escalate to a cloud frontier model like Claude Opus 5. Why it matters: it offers a blueprint for agentic workflows where companies can safeguard sensitive IP without sacrificing frontier reasoning.

  3. Open sourceReach 45

    OpenHistory tracks your Mac workday with local AI

    Zach Tratar just open-sourced OpenHistory, a Mac app that monitors your workday and turns computer activity into hourly and daily summaries. Everything stays completely on your device using local inference, and it connects directly to local AI agents via secure MCP.

  4. AI modelsReach 50

    Ornith-1.5 models invent their own tasks to self-improve

    Ornith.ai just launched Ornith-1.5, a family of open models built around a self-improvement loop where the AI proposes its own training tasks, builds scaffolds, and learns via reinforcement learning. The flagship 397B version matches Claude Opus 4.8 on key coding benchmarks, while the compact 9B variant can run on smartphones.

  5. Open sourceReach 48

    Audio8TS: a tiny 1.7GB text-to-speech model for local voice cloning

    Audio8 just dropped Audio8TS, an ultra-compact text-to-speech model with roughly 100M parameters and a tiny 1.7GB footprint. It pulls off zero-shot voice cloning from just a few seconds of reference audio and even ships with an ONNX INT8 build for low-resource CPU inference. Running high-quality voice cloning locally on a basic laptop is now genuinely practical.

  6. Open sourceReach 48

    Block open-sources Berd, a desktop workspace for agent crews

    Block just open-sourced Berd, a canvas-based desktop environment built to coordinate specialized AI agents directly alongside your local files and repos. Users can spin up agents with distinct skills and personalities while swapping underlying models on the fly. It is a thoughtful push to move AI interactions away from disposable chat windows toward durable project building.

  7. AI modelsReach 49

    Google DeepMind's SL2T lets Pixel 11 users sign directly into apps

    Google DeepMind just introduced SL2T, a sign-language-to-text model rolling out on the Pixel 11's Gboard and Live Transcribe. Trained on over 100,000 hours across 50+ sign languages, it tracks body landmarks on-device to translate ASL directly into English text for searches, chats, and Gemini prompts. It basically gives signers the exact same hands-free dictation hearing users have had for years.

  8. AI toolsReach 41

    Unsloth drops an all-in-one desktop app to run and train local AI

    Unsloth just launched Unsloth Desktop, a free and open-source app that lets anyone run and train local models without touching Python or the command line. Built on Tauri for Mac, Windows, and Linux, it cuts VRAM usage by 70% while doubling fine-tuning speeds across major hardware chips. Why it matters: It finally removes the tedious environment setup barrier from local model customization.

  9. Open sourceReach 48

    Cactus Needle 2 fits an offline AI model into just 28MB of RAM

    Cactus just rolled out Needle 2, an ultra-tiny 45M-parameter model that packs into a 14MB binary and uses only 28MB of RAM. Built for micro-devices like the Raspberry Pi 5 and sub-$200 phones, it clocks hundreds of tokens per second for local tool calling without needing a GPU.

  10. Open sourceReach 60

    Meta opens Muse Glimmer, an agentic 30B model built for consumer GPUs

    Meta just released Muse Glimmer, a 30B open agentic model under an Apache 2.0 license. Quantized to roughly 4-bit precision, it shrinks under 20GB to run smoothly on a single consumer GPU or Mac while handling complex tool calls, visual context, and multi-step reasoning. Basically, robust always-on AI agents can finally run entirely offline on local hardware.

  11. Open sourceReach 48

    Tencent open-sources Octop, a self-hosted multi-agent assistant

    Tencent just open-sourced Octop, a self-hosted platform that runs a multi-agent environment from a single local process. It connects directly with chat apps like WeChat, Feishu, and Discord, letting specialized agents collaborate on complex workflows while keeping all conversation history, knowledge bases, and memory strictly on your own machine.

  12. Open sourceReach 46

    NVIDIA opens its frontier self-driving model for commercial use

    NVIDIA just made its Alpamayo 2 Super autonomous vehicle model available for commercial use under the OpenMDW-1.1 license. Built on Cosmos 3 Super Reasoner with three times the scale of its 10-billion-parameter predecessor, it beats GPT-4o by 23.2 points on LingoQA. It fuses 360-degree camera views to generate driving paths and causal reasoning traces, giving automakers full control over deployment.

  13. Open sourceReach 48

    OpenMinis embeds a full Linux shell for AI agents on your phone

    OpenMinis just open-sourced a cross-platform mobile AI agent app that embeds a sandboxed Alpine Linux environment right on iOS and Android. Bring your own Claude, GPT, or Gemini API keys to automate mobile browsing, execute scripts, and control native device tools like Apple Health and Reminders.

  14. AI modelsReach 54

    Nanbeige's 3B agent model punches way above its weight

    Nanbeige just dropped Nanbeige 4.2, a 3B agentic model that uses a looped Transformer architecture to reuse layers instead of adding parameters. Weighing only 8GB, it fits easily on consumer GPUs while topping larger models like Qwen 3.5 9B on agentic benchmarks. Why it matters: smart architectural loops make capable local coding agents practical on everyday hardware.

  15. Open sourceReach 49

    Andrew Ng's new open-source agent delivers finished work on Mac

    Andrew Ng just launched OpenWorker, an open-source Mac agent designed to hand you finished work like drafted reports, Slack messages, and calendar updates rather than just chatting. It works across your local files, pauses for confirmation before consequential actions, and lets you plug in your own API key or run locally via Ollama. Basically, it gives users a privacy-first coworker where your data never leaves your machine.

  16. IndustryReach 38

    Tesla expands Robotaxis to Florida ahead of earnings

    Tesla just announced it's launching its Robotaxi service in Orlando and Tampa, posting service area maps right ahead of its Q2 earnings call. However, the company shared no details on fleet size or immediate rider availability. With trackers showing barely 21 unsupervised cars in Texas, the reality of the rollout still lags far behind Elon Musk's bold predictions.

  17. Open sourceReach 48

    ABot-World runs infinite interactive worlds on a desktop GPU

    ABot-World just open-sourced a real-time world simulator that lets you continuously explore and steer an AI-generated environment with action controls. It runs on a single desktop RTX 5090 GPU, delivering 720p video at 16 FPS with 1.2-second latency. Basically, instead of short video clips, you get an endlessly unfolding world running entirely on local consumer hardware.

  18. Open sourceReach 48

    Microsoft open-sources Mage Flow for instant image generation and editing

    Microsoft just released Mage Flow, an open-source 4B-parameter model that handles both text-to-image generation and instruction-based editing. It features native ControlNet capabilities and multilingual text rendering, while a 4-step Turbo variant spits out 1024px images in under 0.6 seconds on a single A100. At 17.5GB, it brings fast, interactive image manipulation directly to mid-to-high-end GPUs.