Skip to content
IFAI

On-device AI

Industry tag622 stories

  1. Open sourceReach 45

    Cua open-sources a small model that fills forms in one pass

    Cua just open-sourced CUA-S1-FORMS, the first in its family of small, specialized models built for computer use. Instead of clicking through fields one step at a time, it processes entire forms in a single pass using four core actions and field values pulled from a document. The release is MIT-licensed with the model, dataset, and code all public.

  2. AI toolsReach 49

    Muse for Mac lands on desktop as a personal AI agent

    Alexandr Wang just launched Muse for Mac, an AI agent capable of handling tasks across your files, messages, calendar, and notes directly on your computer. You keep full control over data access, and it requires explicit confirmation before executing any sensitive actions.

  3. Open sourceReach 48

    Bonsai-2 crunches 27B models down to 6GB with ternary weights

    prism-ml just launched Bonsai-2, a collection of radically compressed models that restrict weights to -1, 0, and +1. The approach shrinks a 27B-parameter base model to under 6GB—slashing its footprint by over 9x while preserving baseline performance on consumer-grade GPUs and Apple silicon.

  4. AI modelsReach 50

    Needle 3 fits an AI agent into 8 MB

    Cactus just rolled out Needle 3, a tiny foundation model packed into a single 8–29 MB binary for smartwatches and microcontrollers. It trades general chat capacity to excel at offline tool calls and data extraction, scaling from 2 to 20 layers based on hardware limits. Why it matters: developers can now build instant, fully offline actions directly on tiny edge devices without relying on the cloud.

  5. AI toolsReach 40

    Perplexity brings local AI agents to Windows RTX PCs

    Perplexity just launched Portable Computer on Windows, bringing its multi-step agent to NVIDIA GeForce RTX PCs and RTX PRO workstations with 24GB+ VRAM. It runs models like Qwen 3.8 27B entirely on-device, letting you analyze files and connect to tools like Slack and GitHub without leaking data or burning cloud credits.

  6. AI toolsReach 43

    Apple launches Siri AI with screen awareness and personal context

    Apple just rolled out Siri AI alongside the next generation of Apple Intelligence, rebuilding its assistant to tap into personal context across messages, mail, and on-screen content. It can now take multi-step actions across third-party apps and sync chats across devices in a dedicated Siri app. The beta is live today in English.

  7. Open sourceReach 48

    ZGCM-1 packs heavy math and search skills into 7B parameters

    Zhongguancun researchers just released ZGCM-1, an open 7.39B model specialized in mathematical reasoning and agentic web search with 256K context support. It hits 97.13% on MATH-500 and comes with fully disclosed data and training pipelines ready for consumer GPUs. Why it matters: Small, highly specialized open-source models are becoming genuinely capable at complex reasoning tasks without enterprise hardware.

  8. Open sourceReach 48

    Edge0 runs 35B models in 2.5 GB of RAM by streaming from SSD

    Edge0 just open-sourced a streaming MoE inference framework that treats storage like memory, running 35B models in roughly 2.5 GB of active RAM on iPhones and Macs. By predicting routing one step ahead to hide SSD read latency, it squeezes large models onto low-memory consumer devices without crushing performance.

  9. AI toolsReach 40

    Apple's Siri AI arrives with limits and paywalls

    Apple just confirmed that its delayed Siri AI assistant will launch in beta on September 14 alongside iOS 27, complete with daily server usage caps and plans for future paid tiers. The initial release only supports English, blocks users under 13, and is unavailable in mainland China. Why it matters: Apple's personal assistant overhaul is finally arriving, but cloud compute constraints mean free, unlimited access is officially off the table.

  10. IndustryReach 48

    Apple enters the foldable era with iPhone Duo

    Apple just unveiled the iPhone Duo, its first foldable device featuring a 7.6-inch inner display and the A20 Pro chip. The dual-screen flagship runs iOS 27 and introduces an overhauled Siri AI capable of onscreen awareness and real-time AI camera tracking. It marks Apple's biggest hardware leap yet to anchor personal AI across flexible displays.

  11. IndustryReach 42

    Apple unveils iPhone 18 Pro with A20 Pro and Siri AI

    Apple just introduced the iPhone 18 Pro lineup, packed with a 2nm A20 Pro chip that doubles on-device AI power via a 32-core Neural Engine. The flagship adds a hardware variable aperture camera and deeply integrates an all-new Siri AI. Pre-orders kick off September 12.

  12. Open sourceReach 48

    Tencent open-sources AuK, an audio model that edits speech like text

    Tencent just open-sourced AuK, a 1.5B foundation model that lets you generate and edit speech using simple text prompts. Beyond zero-shot voice cloning, it can seamlessly insert or delete words from existing audio, tweak emotional tone, and remove background noise. It brings text-editor simplicity to voice workflows and runs on consumer GPUs.

  13. Open sourceReach 59

    OpenBMB's 2B model punches well above its weight

    OpenBMB just open-sourced MiniCPM5-2B, a compact 2-billion-parameter dense model that punches above 4B-class models like Qwen3.5-4B across coding and math benchmarks. Weighing only around 5GB, it easily runs locally on consumer edge hardware, and the team also released the full high-quality dataset behind it.

  14. IndustryReach 34

    Rivian rolls out RivianOS 2 to all R1 vehicles

    Rivian just rolled out its 2026.31 OTA update, bringing RivianOS 2 to all R1 models in the vehicle's biggest software overhaul to date. The update unifies R1 and R2 onto a single AI-defined platform with an overhaul of the UI, Unreal Engine real-time cabin visuals, and new granular privacy toggles.

  15. AI toolsReach 42

    Nvidia PAIR turns your idle home PCs into a distributed AI cluster

    Nvidia just released Personal AI Router (PAIR), a free open-source tool that links idle computers across your home network into a shared local AI compute cluster. It works with RTX 20-series GPUs and newer, plus Apple M4 chips, automatically stepping aside when you start gaming. A beta is out now for Windows, Linux, and macOS.

  16. Open sourceReach 48

    H3 World: Turn open-source video models into playable worlds

    H3 World just turned the open-source Miniax H3 video generator into an interactive game engine. Instead of building a complex control rig, it simply translates keystrokes into short text prompts that guide the video's motion in real time. The project code, local setup instructions, and training scripts are now fully open-sourced.

  17. Open sourceReach 55

    Perplexity's tiny 0.6B model catches leaks before they leave your Mac

    Perplexity just launched PII-TRACE and PII-Tracer, a benchmark and 0.6B local model built on Qwen3 to screen sensitive data before routing tasks to cloud models. It achieved the highest character F1 among 12 detectors and stayed accurate across multi-turn chats. Why it matters: hybrid AI only works if on-device gates know exactly what to hide.

  18. AI modelsReach 42

    Alibaba turns its Qwen LLM into a self-driving brain

    Alibaba just released Qwen-Drive-1.0, a vision-language foundation model tailored for autonomous driving. Built on Qwen3.5-4B without changing the underlying architecture, it plugs in a BEV perception head and a diffusion planning expert to handle 3D sensing and trajectory generation. It shows general VLMs can take the wheel without rebuilding them from scratch.

  19. Open sourceReach 48

    Google drops TimesFM 3.0 with native multivariate forecasting

    Google Research just open-sourced TimesFM 3.0, its third-generation time-series foundation model that now natively handles multivariate forecasting. It evaluates multiple correlated trends and planned future events with zero-shot accuracy, runs on just 1GB of VRAM, and completes full-horizon forecasts in a single forward pass under a non-commercial license.

  20. AI toolsReach 38

    NVIDIA upgrades DLSS 4.5 with second-gen transformer

    NVIDIA just rolled out DLSS 4.5 Ray Reconstruction, powered by a second-generation transformer model to dramatically sharpen ray-traced and path-traced graphics. The neural rendering update is already live across 30 games via the NVIDIA app, cutting down ghosting artifacts. NVIDIA also previewed RTX Mega Geometry, bringing full-detail Nanite ray tracing to upcoming titles.