Skip to content
IFAI

AI tools

Microsoft gives Copilot 'eyes' on Windows

Published Reach 68

Microsoft just rolled out Copilot Vision with Highlights for Windows 10 and 11 users in the US for free. Clicking the new glasses icon lets the AI see your selected app, talk through tasks in real time, and highlight exactly where to click next. It is opt-in, doesn't require Copilot Pro, and remains limited to US users for now.

Microsoft gives Copilot 'eyes' on Windows
Image: blogs.windows.com

We have all been there—staring at a dense software menu, totally lost, wishing a knowledgeable friend could just lean over our shoulder and point at the right button.

Microsoft is now trying to turn Copilot into that exact friend on your PC.

Copilot Vision with Highlights has officially rolled out to all Windows 10 and Windows 11 users in the US. Even better for regular users, Microsoft dropped the previous requirement for a Copilot Pro subscription. It is free to use, though it remains part of the experimental Copilot Labs umbrella. The feature is also available across iOS and Android.

A glasses icon and an opt-in screen share

Any time an AI feature mentions looking at your desktop, memories of Microsoft's controversial Recall feature naturally surface. But Copilot Vision takes a completely different approach.

Instead of quietly snapping continuous screenshots in the background, this is an entirely opt-in experience. Inside the Copilot app, you will find a glasses icon. Clicking it allows you to pick a specific browser window or app you want to share with the AI, exactly like sharing your screen in a Microsoft Teams meeting.

If you do not explicitly share an app, Copilot sees nothing. The team describes it as your "second set of eyes" that can analyze content, answer questions on the fly, and chat with you in real time as you browse or work.

Highlights turns Copilot into a hands-on coach

Seeing what is on your screen is neat, but the standout addition here is Highlights.

Instead of just rambling through a multi-step text explanation when you are confused, Copilot can now literally show you what to do. When you ask it to "show me how," the AI highlights the exact button or menu you need to click directly inside the active app.

Microsoft points to real-world use cases like coaching someone through complex Adobe Photoshop features, or reviewing a travel itinerary on one page to verify that your packing list covers everything needed for the trip. Early hands-on previews from Microsoft's 50th anniversary event in April showed that this live pointing mechanism makes software onboarding feel remarkably fluid.

Why it matters

We think this is a genuinely smart pivot for Microsoft after the backlash over Recall.

By moving away from passive desktop monitoring and toward an on-demand, session-based screen share, Microsoft gives users full control over their privacy while still delivering the power of multimodal AI. You do not have to copy-paste error messages, take crops of your screen, or craft elaborate prompts anymore. You just show the AI your window and talk.

For everyday users and beginners wrestling with intimidating software suites, this could be a game-changer. It basically turns Windows into a built-in interactive tutor for any desktop application.

That said, keeping the rollout restricted to the US and housed inside Copilot Labs signals that Microsoft is still testing the waters. Real-time vision and overlay accuracy across thousands of diverse third-party applications will be tricky to maintain, and latency could still make or break the illusion of an effortless copilot.

Sources (4)

  1. [1]
    microsoft.com(opens in a new tab)Originalmicrosoft.com
  2. [2]
  3. [3]
  4. [4]

Best of AI, daily