Skip to content
IFAI

Industry

Reddit sues Perplexity for scraping content to feed AI

Published Reach 45

Reddit just sued Perplexity and three data scraping providers, alleging they bypass protections to illicitly siphon forum posts for its AI "answer engine." Reddit claims it set a trap by publishing a post accessible only to Google, which Perplexity surfaced within hours by allegedly scraping search results. Perplexity responded that it doesn't train models and refuses to bow to strong-arm licensing tactics.

Reddit sues Perplexity for scraping content to feed AI
Image: theverge.com

If you want to feed your AI engine on the internet's richest well of human conversation, you had better bring a massive checkbook.

Reddit just filed a lawsuit against AI search darling Perplexity and three web scraping providers, Oxylabs, AWMProxy, and SerpApi. In the complaint, Reddit pulls no punches, accusing the defendants of industrial scale data theft and running a high tech data laundering ring.

The Google SERP sting operation

The feud actually kicked off in May 2024 when Reddit slapped Perplexity with a cease and desist letter. Perplexity claimed at the time that it was not training foundation models on Reddit posts and promised to honor the platform's robots.txt rules.

Instead of backing off, Perplexity reportedly ramped up its citations of Reddit content.

Reddit then decided to set a digital trap. The company created a test post indexed exclusively for Google's crawler. Within hours, Perplexity's answer engine spat out the contents of that hidden post. Reddit argues the only possible explanation is that Perplexity and its scraping vendors scraped Google search result pages to siphon off Reddit content through the back door.

Reddit chief legal officer Ben Lee compared the scraping outfits to would-be bank robbers who hijack the armored cash transport when they cannot crack the vault.

Pushing back against data tolls

Perplexity is not backing down quietly. Communications head Jesse Dwyer said the company will vigorously defend the right to freely access public knowledge.

In a follow-up statement, Perplexity argued that as an application layer product, it has never trained AI models on third-party content and therefore has no reason to sign an AI training license. The company claimed Reddit tried to shake them down for payment a year ago, calling it strong-arm tactics.

Data provider Oxylabs also fired back, expressing shock and arguing that no private corporation should claim exclusive ownership over public web data to inflate pricing.

Why it matters

This lawsuit cuts straight to the core of how AI answer engines operate today.

For regular users, Perplexity works so well precisely because it surfaces raw, human perspective from Reddit threads while filtering out SEO sludge. If Perplexity gets blocked from indexing Reddit, the quality of its everyday recommendations will take a noticeable hit.

We think Reddit's sting operation was brilliantly executed. By creating a Google-only post and watching Perplexity surface it within hours, Reddit built a clean, intuitive chain of custody that will look compelling to a judge.

At the same time, this battle signals a grim trend for the open web. Giants like Google and OpenAI have already paid up for Reddit firehose access. If real-time retrieval of public pages gets legally classified as theft, only the richest tech titans will be able to afford building an AI search engine, leaving smaller startups completely locked outside the garden wall.

Sources (1)

  1. [1]
    theverge.com(opens in a new tab)Originaltheverge.com

Best of AI, daily