#ai-crawlers

[ follow ]
#cloudflare #web-scraping #pay-per-crawl #content-monetization #bot-traffic #content-creation
Artificial intelligence
fromTheregister
1 day ago

AI insiders seek to poison the data that feeds them

A grassroots initiative called Poison Fountain urges website operators to feed poisoned data to AI crawlers to degrade and undermine AI model quality.
Media industry
fromDigiday
2 weeks ago

Here are the biggest moments in AI for publishers in 2025

Generative AI significantly reduced publishers' search referral traffic and forced widespread changes in licensing, crawler blocking, and product strategies.
Artificial intelligence
fromDigiday
1 month ago

Inside The Atlantic's AI bot blocking strategy

The Atlantic blocks AI crawlers that don't send readers back or generate subscriptions, allowing only those that provide demonstrable value or licensing fees.
#web-scraping
more#web-scraping
#cloudflare
fromDigiday
2 months ago
Miscellaneous

Cloudflare CEO Matthew Prince on why Google must 'play by the same rules' as other AI companies

fromZDNET
6 months ago
Privacy professionals

Cloudflare declares war on AI crawlers - and the stakes couldn't be higher

fromMarTech
6 months ago
Privacy technologies

Cloudflare rolls out a way for sites to charge AI crawlers for access | MarTech

fromIT Pro
6 months ago
Privacy technologies

Cloudflare says AI companies have been "scraping content without limits" - now it's letting website owners block crawlers by default

fromDigiday
2 months ago
Miscellaneous

Cloudflare CEO Matthew Prince on why Google must 'play by the same rules' as other AI companies

fromZDNET
6 months ago
Privacy professionals

Cloudflare declares war on AI crawlers - and the stakes couldn't be higher

fromMarTech
6 months ago
Privacy technologies

Cloudflare rolls out a way for sites to charge AI crawlers for access | MarTech

fromIT Pro
6 months ago
Privacy technologies

Cloudflare says AI companies have been "scraping content without limits" - now it's letting website owners block crawlers by default

more#cloudflare
Marketing tech
fromMarTech
3 months ago

Invisible pages, lost revenue: Why crawlability poses a huge risk | MarTech

Websites must prioritize crawlability for their highest-value pages so both AI and traditional crawlers allocate limited crawl budget to revenue-driving content.
Information security
fromTheregister
4 months ago

AI crawlers destroying websites in hunger for content

AI web crawlers now generate massive bot traffic, causing performance degradation, service disruptions, and increased operational costs for websites.
fromgizmodo.com
6 months ago

Free Lunch Is Over for the AI That Broke the Web

Cloudflare has announced a revolutionary policy where AI crawlers must pay content creators for the data they take, marking a shift in internet practices.
Privacy technologies
Media industry
fromDigiday
6 months ago

Media Briefing: 'Cloudflare is locking the door': Publishers celebrate victory against AI bot crawlers

Cloudflare provides a tool enabling publishers to block AI crawlers with one click, marking a significant win for content protection.
[ Load more ]