Skip to content

Home
AI
Linux
Open source
Hardware
Security

Matthew Prince

Cloudflare launches Content Signals Policy to fight AI crawlers and scrapers

September 24, 2025 Brian Fagioli

Cloudflare Fights AI Scraper

Cloudflare is giving publishers and site owners a way to declare preferences on how AI companies use their content, expanding robots.txt with new policy language.

Categories Artificial Intelligence Tags AI crawlers, AI training, Cloudflare, Content Signals Policy, data scraping, Matthew Prince, open web, publishers, robots.txt, website owners Leave a comment

Cloudflare blocks AI bots by default to protect content creators and fix a broken internet model

July 7, 2025July 2, 2025 Brian Fagioli

cloudflare blocks ai robot stop.jpg

Cloudflare is now blocking AI crawlers by default, putting control back in the hands of content creators. This new permission-based model stops unauthorized scraping and helps protect the future of original work online.

Categories Artificial Intelligence Tags AI crawlers, AI data collection, BuzzFeed, Cloudflare, content scraping, Matthew Prince, online journalism, permission-based AI, Reddit, web publishing 1 Comment

Join our newsletter!

Real tech news for real nerds

Subscribe via RSS

Featured Articles

I used ChatGPT 5 to help me buy a car and here’s what happened
Microsoft forces workers back to the office and it stinks
Google TV and Android TV apps must support 64-bit starting August 2026
Lenovo’s PC business surges to 15-quarter high with AI models leading the charge
Man controls iPad with his mind using Synchron brain implant

© 2025
NERDS.xyz
All rights reserved

About Contact Privacy Policy Editorial Policy

© 2025 NERDS.xyz • Built with GeneratePress

Search for: