Skip to content
IFAI

Industry

ChatGPT private chats leak into Google's webmaster tools

Published Reach 44

OpenAI just patched a bizarre privacy glitch after researchers discovered users' raw, personal ChatGPT prompts were appearing inside Google Search Console reports. The leaks, which included sensitive relationship and business queries, suggest OpenAI may have been directly scraping Google with actual user inputs. While OpenAI says the routing issue is fixed, questions about its scraping methods remain.

ChatGPT private chats leak into Google's webmaster tools
Image: arstechnica.com

For months, deeply personal and sensitive ChatGPT conversations have been leaking into one of the most unexpected places on the web: Google Search Console.

The tool is typically used by site owners and webmasters to monitor search keywords and traffic performance. Normally, these reports show short phrases that people type into Google.

Starting this September, however, website owners started spotting bizarre entries in their logs, some exceeding 300 characters long.

Prompts leaking into search logs

The leaked queries showed raw user prompts, appearing to come from people asking a chatbot for help with delicate relationship issues, personal dilemmas, or private business problems. The users clearly assumed these exchanges were strictly private between them and the bot.

Jason Packer, owner of analytics consulting firm Quantable, first flagged the anomaly in a detailed blog post last month. To pinpoint what was actually going on, he teamed up with web optimization consultant Slobodan Manić to run technical experiments.

Together, they gathered evidence pointing to what they believe is the first definitive proof that OpenAI has been directly scraping Google Search using raw user prompts. Their investigation suggested OpenAI may have compromised user privacy simply to grab search data that Google otherwise would not share.

OpenAI declined to confirm Packer and Manic's theory or provide specifics on the scope of affected users.

However, an OpenAI spokesperson did acknowledge the problem, stating the company resolved a glitch that temporarily affected how a small number of search queries were routed.

Packer noted he was pleased with the quick fix, but pointed out that OpenAI completely sidestepped the question of whether it was scraping Google, leaving lingering doubts about whether the underlying privacy hole is truly closed.

Why it matters

This incident is a massive wake-up call for anyone treating conversational AI like a private therapist or confidential advisor.

Most users assume prompts remain siloed inside their personal chat interface. It turns out that when a model decides to browse the web, your unfiltered, deeply personal sentences might be blasted across the open web and recorded permanently inside third-party developer dashboards.

If you use web-enabled chatbots for sensitive commercial strategy or personal issues, you should immediately strip out names, context, and identifiable data before hitting send.

For the broader industry, this reveals the messy compromises happening behind the scenes of AI search. Web-crawling bots are desperate for real-time information, but directly passing raw user prompts as search queries looks like remarkably lazy engineering that sacrifices user trust to bypass search platform barriers.

Sources (1)

  1. [1]
    arstechnica.com(opens in a new tab)Originalarstechnica.com

Similar events

Past happenings like this one, for context.

Best of AI, daily