Skip to content
NERDS.xyz
  • Home
  • AI
  • Linux
  • Open source
  • Hardware
  • Security

site blocking

Cloudflare says Perplexity is using hidden crawlers to bypass site blocks and I’m honestly shocked

August 4, 2025 Brian Fagioli
stealth crawler security

Cloudflare has accused Perplexity of disguising its crawlers and ignoring robots.txt rules, a shocking move that could have legal consequences.

Categories Artificial Intelligence Tags AI crawler, bot evasion, ChatGPT, Cloudflare, hidden bots, OpenAI, Perplexity, robots.txt, site blocking, web scraping Leave a comment

Join our newsletter!

Real tech news for real nerds

Join
Subscribe via RSS

Featured Articles

  • Microsoft forces workers back to the office and it stinks
  • Google TV and Android TV apps must support 64-bit starting August 2026
  • Lenovo’s PC business surges to 15-quarter high with AI models leading the charge
  • Man controls iPad with his mind using Synchron brain implant
  • AI code generators are writing vulnerable software nearly half the time
© 2025
NERDS.xyz
All rights reserved
About Contact Privacy Policy Editorial Policy
© 2025 NERDS.xyz • Built with GeneratePress