Skip to content
IFAI

AI tools

Apple drops major Apple Intelligence update across all devices

Published Reach 42

Apple just rolled out new Apple Intelligence capabilities across its hardware lineup, headlined by on-device Live Translation for phone calls, FaceTime, and Messages. The update also brings onscreen visual intelligence with ChatGPT integration, dynamic voice coaching in Workout Buddy, and direct developer access to its local foundation model.

Apple drops major Apple Intelligence update across all devices
Image: apple.com

Imagine having a conversation with someone speaking another language, and your earbuds automatically lower their actual voice while whispering a real-time translation right into your ear. That sci-fi scenario just became standard software.

Apple rolled out a massive wave of new Apple Intelligence features across iOS 26, iPadOS 26, macOS Tahoe 26, watchOS 26, and visionOS 26. The update is completely free for compatible devices.

Real-time talk, screen context, and workout pep talks

The marquee addition here is Live Translation, which now touches basically every communication pipeline on the device.

Inside Messages, text translates automatically into the recipient's language as you type. During FaceTime calls, you get live translated subtitles without losing the caller's natural voice. Standard phone calls will actually speak the translation out loud in real time.

For in-person talks, users with AirPods Pro 3 can trigger translation by squeezing both stems at the same time, asking Siri, or hitting the iPhone Action button. Active Noise Cancellation dips the speaker's volume so you can focus on the translation. Italian, Japanese, Korean, and both Simplified and Traditional Chinese will arrive before year's end.

Visual intelligence also expanded onto the glass. You can now press your standard screenshot buttons and highlight anything on screen, like a pair of sneakers, to find matches on Google, eBay, Poshmark, or Etsy. Users can tap ChatGPT for deeper onscreen queries, or turn a flyer into a Calendar event with one tap.

Apple also introduced Workout Buddy. It privately crunches heart rate, pace, and rings locally, generating custom voice encouragement using synthetic speech modeled after Fitness+ trainers.

Giving away on-device models for free

Behind the curtain, Apple pulled off an even bigger play for developers.

Apple has officially unlocked access to the on-device foundational large language model at the heart of Apple Intelligence. It runs completely offline, ties straight into Swift, and AI inference is entirely free of charge for developers.

Early apps are already running with it. Streaks uses it to categorize tasks, CARROT Weather now serves up unlimited conversational forecast banter, and Detail generates teleprompter scripts right from outlines.

Power users also get a massive upgrade in Shortcuts. Automations can now call on-device models or Private Cloud Compute directly, letting people build workflows that compare transcripts to notes or dump PDF info straight into spreadsheets.

Why it matters

We think Apple's smartest decision here is turning on-device AI into free utility plumbing rather than selling it as a standalone chatbot.

For everyday users, in-ear translation and instant screen search solve real daily friction. Being able to highlight a product on your display and instantly price-check it across retail platforms changes how people navigate mobile commerce. If you own an eligible device, testing screen search and live messaging translation alone makes the download worthwhile.

For the tech ecosystem, free on-device inference puts massive pressure on rivals. Indie developers who previously paid OpenAI or Anthropic monthly API fees for simple tasks like sorting to-do lists or drafting text can now offload those costs entirely to Apple silicon.

That said, the seams still show. Routing heavier image generation and complicated visual queries off to ChatGPT indicates Apple's native model capacity still has strict boundaries, and regional rollouts remain noticeably staggered.

Sources (1)

  1. [1]
    apple.com(opens in a new tab)Originalapple.com

Best of AI, daily