Cloudflare launches a marketplace that lets websites charge AI bots for scraping | TechCrunch
Briefly

Cloudflare has introduced a marketplace called Pay per Crawl, allowing website owners to control and monetize access to their content by AI crawlers. This initiative is designed to give publishers the ability to set individual rates for crawlers or block access entirely. Cloudflare's tools provide insights into how crawlers engage with publisher sites. The marketplace offers a potential new business model amidst declining Google Search traffic, as publishers seek to adapt in an era increasingly influenced by AI technology.
Cloudflare's new marketplace, Pay per Crawl, allows website owners to control AI access, setting individual rates for crawlers or blocking them entirely.
The marketplace aims to create a new business model for publishers, granting them compensation and visibility into how AI crawlers utilize their content.
Cloudflare's tools address the challenges publishers face as AI crawlers rise, providing insight into site visits and potential monetization opportunities.
Amid diminishing traffic from Google Search, news publishers are exploring innovative models to adapt and thrive in the evolving digital landscape.
Read at TechCrunch
[
|
]