
AI Site Perplexity Accused of Bypassing No-Crawl Directives Using Stealth Tactics
The AI search platform, Perplexity, has been accused of utilizing stealthy bots to bypass websites' no-crawl mandates. This situation raises concerns about violating longstanding Internet protocols, according to Cloudflare, a service focused on network security and optimization.
Cloudflare reported in a blog post that complaints were received from site