Cloudflare CEO: AI bots will surpass human web traffic by 2027

When you shop for a digital camera, you might open five browser tabs, compare prices, and call it a day. But if you assign that exact same chore to an AI agent, it will easily scour 5,000 websites before giving you a response.

That staggering difference is about to reshape the physical reality of the internet. Speaking at the SXSW conference in Austin on March 19, Cloudflare CEO Matthew Prince predicted that AI bot traffic will outpace human web traffic by 2027.

From 5 tabs to 5,000 requests

Before generative AI showed up, bots accounted for roughly 20% of online activity. Google’s search crawler was by far the biggest, while most of the rest came from scammers, bad actors, and a handful of reputable indexers.

Today, generative AI has created an insatiable hunger for data. Worse yet, AI agents designed to handle multi-step user tasks generate an unprecedented wave of traffic.

Prince noted that when an AI bot plans your vacation or searches for a product, it visits up to 1,000 times the number of websites an actual human would. That translates to real hits on origin servers, real bandwidth, and real server strain across the web.

The permanent surge

What worries infrastructure providers most is the curve of this growth.

Prince recalled that during the early days of Covid, internet usage spiked dramatically within two weeks as everyone streamed YouTube, Netflix, and Disney. Some parts of the web nearly buckled, but traffic eventually plateaued at that new baseline.

AI traffic is behaving very differently. It is compounding steadily with no sign of slowing down or hitting a ceiling. Physical data centers are absorbing a relentless tide of crawler and agent activity.

To handle this shift, Prince argued that the web needs new building blocks, specifically lightweight, ephemeral sandboxes. When an agent needs to execute code, an isolated sandbox should spin up as effortlessly as opening a browser tab and tear down the second the job is done. He expects the internet will soon spin up millions of these sandboxes every single second.

Of course, warning everyone about server overload happens to be phenomenal marketing for Cloudflare, which protects and accelerates about one-fifth of the entire web. But it also gives Prince a front-row seat to the shift.

Why it matters

Prince called AI a fundamental platform shift on par with the migration from desktop to mobile. The way the world consumes information is changing at the protocol level.

We think this transition exposes an unsustainable economic hole in the modern web. The entire open internet was built on a simple trade: site owners publish content, humans visit, and ads or subscriptions pay the server bill. When an AI bot hits 5,000 pages to summarize an answer for one person, the publisher eats the hosting costs while capturing zero human attention.

For independent site owners and developers, this means the pressure to put up paywalls or deploy bot blockers is reaching an all-time high. Cloudflare and its competitors will happily sell you shields to block unwanted crawlers, but defensive measures only treat the symptom.

If bots account for more than half of all traffic by 2027, the open web’s existing business model will be completely broken. Either AI companies start paying for the compute they burn across the web, or the internet will lock its doors behind private APIs.