AI Crawler Robots.txt Audit & llms.txt Checker

Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.

Publisher description, verbatim

Last 7 dayson this actor

4other changes

Each one reaches followers by email the morning after.Follow this actor

Key figures24 readings

Price / 1k$8.00per 1,000 results

Users / 30d3↑ 1 over 24 readings

Users, all time3↑ 1 over 24 readings

Runs / 30d31↑ 8 over 24 readings

Runs / user / mo10.3runs per monthly user

Users / 30d24 readings

Recorded changes

showing 3 of 8 in the last 30 days · followers get all 8 by email

2026-09-08changeBack on the store—on record
2026-09-05changeRemoved from the store—on record
2026-09-04changeBack on the store—on record

Follow this actor, compare it against its rivals, and get every overnight change in one morning report. Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Publish this actor? Claim the page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.