How to Block AI Crawlers and Keep Your AI Search Traffic
We read a week of our own bot traffic and checked every AI crawler against its owner's IP list. One in seven GPTBots wasn't GPTBot. Here's how to block the right ones.
We read a week of our own bot traffic and checked every AI crawler against its owner's IP list. One in seven GPTBots wasn't GPTBot. Here's how to block the right ones.
You can block bots collecting content while letting assistants fetch pages to answer users.