Media industry
fromDigiday
1 day agoCloudflare's compliant crawler highlights tension - and opportunity - in the emerging AI content market
Cloudflare launched a compliant crawl API to give publishers control over web scraping while facing criticism for the apparent contradiction of a company that previously blocked scrapers now building one.