Skip to content
IFAI

AI tools

Google upgrades Search's AI Mode with PDF uploads and live video

Published Reach 48

Google just expanded AI Mode in Search with desktop support for images and incoming PDF uploads that cross-reference the web. The update also brings a dynamic Canvas side panel for building study plans and rolls out Search Live, bringing real-time video queries from Project Astra directly into Lens. Most features are currently available to enrolled Labs users in the U.S.

Google upgrades Search's AI Mode with PDF uploads and live video
Image: blog.google

Google is turning its classic search bar into an all-in-one multimodal workspace.

Just ahead of the back-to-school rush, Google announced a massive wave of upgrades to AI Mode in Search. The update rolls out PDF document analysis, an interactive Canvas side panel for project planning, and live video interaction powered by Project Astra.

Desktop users will now spot a dedicated AI Mode button right on the Google homepage.

From asking questions to building workspaces

While mobile users have been able to ask questions about images in the Google app for a while, that capability is finally landing on desktop browsers this week. More importantly, Google confirmed that desktop PDF uploads are arriving in the coming weeks.

Students or researchers can drop in lecture slides or research papers, and AI Mode will synthesize the document while pulling in verified context and links from the open web. Google plans to expand this to additional file types and Google Drive files later this year.

Alongside document uploads comes Canvas, a dynamic side panel designed to help users organize multi-step projects across sessions.

Instead of losing your prompt history, you can tap Create Canvas to outline a study schedule or travel itinerary, refining the document conversationally as you go. Google says users will soon be able to feed their own class notes directly into Canvas to generate custom study guides.

Project Astra comes to life in Search Live

The biggest technical leap is Search Live with video input, bringing Google's Project Astra capabilities straight into everyday search.

By opening Google Lens on mobile and tapping the new Live icon, users can point their camera at real-world objects and hold a natural, real-time spoken conversation with AI Mode. Robby Stein, VP of Product for Google Search, described it as having an expert on speed dial who sees what you see and talks through tricky concepts live.

On desktop, Chrome is also integrating deeper with AI Mode. Clicking the address bar will soon surface an Ask Google about this page option, letting you highlight diagrams on any webpage to trigger an instant AI Overview with follow-up queries.

Currently, PDF and image capabilities are rolling out to English users aged 18+ in the US and India, while Canvas and Search Live are launching for US users enrolled in the AI Mode Labs experiment.

Why it matters

Google is redefining what a search engine actually does.

For students, knowledge workers, and everyday users, turning search into an interactive canvas means far less app-switching. Instead of juggling a PDF reader, a chatbot, and a note-taking app, you can drop a file into search, chat with your camera when you are stuck, and organize the results in one side panel.

For the broader AI landscape, this is Google leaning heavily on its unfair distribution advantages. While competitors like OpenAI and Perplexity offer great conversational search, Google owns Chrome, Android, and Google Lens. Pairing Project Astra's low-latency video feed directly with Lens creates an ambient search experience that rivals will struggle to match.

We think shifting search from a transactional query box to a persistent workspace is a smart defensive play. The challenge, however, will be keeping Search fast and clutter-free without overwhelming people who just want a quick answer.

Sources (2)

  1. [1]
    blog.google(opens in a new tab)Originalblog.google
  2. [2]
    techcrunch.com(opens in a new tab)Reporttechcrunch.com

Best of AI, daily