AI Crawler Checker – robots.txt Rules for GPTBot & ClaudeBot

AI crawler checker: read each website's robots.txt and see whether GPTBot, ClaudeBot, Google-Extended, PerplexityBot, CCBot and 13 other AI crawlers are allowed or blocked, with the line that decided each verdict, plus Content-Signal and llms.txt.

Publisher description, verbatim

Last 7 dayson this actor

No changes seen in the last 7 days.

The morning one happens, followers hear first.Follow this actor

Key figures14 readings

Price / 1k$0.50per 1,000 results

Users / 30d1↑ 1 over 14 readings

Users, all time1→ 0 over 14 readings

Runs / 30d15↑ 14 over 13 readings

Runs / user / mo15.0runs per monthly user

Recorded changes

2026-09-13contentREADME updated+483 characters+483characters
2026-09-13contentDescription changed—on record
2026-09-12changeListed—on record

showing 3 of 3 in the last 30 days · followers get the next one by email

History

14 readings since 2026-09-12

Users / 30d14 readings

Users, all time14 readings

Runs / 30d13 readings

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported. Not indexed: too little has happened to this actor for us to have anything worth saying yet.