Perplexity allegedly skirts restrictions intended to block its AI crawlers from accessing certain websites. Cloudflare reported that Perplexity conceals its identity and behavior when faced with access limitations. Complaints from customers reveal that Perplexity's bots continued to reach restricted sites, despite implemented robots.txt files and Firewall rules. Cloudflare's testing demonstrated that when blocked, Perplexity changes its user agent to impersonate a legitimate browser and uses rotating IP addresses and variations in its autonomous system networks to evade detection, raising serious ethical concerns about content scraping practices.
Cloudflare claims that Perplexity conceals its crawling identity to circumvent website restrictions, resulting in concerns over unauthorized content scraping from various sites.
Despite implementing robots.txt files and Web Application Firewall rules, website owners reported that Perplexity's bots accessed their sites, sparking further controversy.
Collection
[
|
...
]