Reddit blocks search engines and AI bots — except Google

If you are one of the millions of people who reflexively append "Reddit" to your searches just to dodge AI-generated slop, you might need to rethink your habits.

Over the past few weeks, Reddit has begun blocking nearly all major search engines from crawling its latest posts and comments, according to a report from 404 Media. The only mainstream survivor showing fresh results is Google.

Pay up or get blocked

Running a "site:reddit.com" query on alternatives like Bing, DuckDuckGo, Mojeek, or Qwant now turns up essentially zero results from the past week. Older links still linger, but DuckDuckGo can only show a handful of blank snippets noting that the site will not allow descriptions to be displayed.

The only smaller player still surfacing Reddit is the paid search engine Kagi, and that is simply because it buys part of its index directly from Google.

The blackout follows Reddit's decision to update its robots.txt file on July 1st. Ben Lee, Reddit's chief legal officer, told Command Line that the change was a deliberate signal to those without a formal contract that they should keep their hands off the site's data.

Microsoft confirmed it complied immediately. Microsoft spokesperson Caitlin Roulston told The Verge that Bing stopped crawling Reddit on July 1st because it respects web standards when publishers ask that content not be used for generative AI.

Behind the $60M moat

Why did Google get a pass? Earlier this year, Google inked a massive $60 million licensing deal with Reddit to feed human conversations into its AI training pipeline.

Reddit insists this is not about playing favorites. Reddit spokesperson Tim Rathschmidt told The Verge that the company has been negotiating with multiple search engines, but talks stalled because some were unable or unwilling to make enforceable promises regarding content usage, particularly for AI training.

Competitors are not buying the spin. Mojeek CEO Colin Hayhurst bluntly pointed out that Reddit is effectively killing search for everyone except Google.

It is the culmination of a year-long lockdown. After hiking API prices and crushing third-party apps to prep for its public debut, Reddit is now turning its massive archive of human chatter into high-priced private real estate.

Why it matters

For everyday users, finding authentic, human-written advice just got a lot harder. Appending "Reddit" was basically the web's universal cheat code to bypass SEO spam and machine-written articles. Now, that escape hatch is effectively exclusive to Google.

For the search industry, Reddit's move directly cements Google's monopoly. Just as independent engines were gaining modest traction on privacy and curation, Google bought exclusive access to the internet's most valuable conversational repository. Smaller players simply do not have $60 million lying around to keep basic search results functional.

We think Reddit's strategy is undeniably clever for short-term revenue, but it carries real long-term danger. By treating public community discussions as proprietary training collateral, Reddit is severing itself from the open web. If your posts cannot be found, new users stop arriving, and locking the front door is rarely a winning strategy for an online forum.