AI Crawler Robots.txt Audit & llms.txt Checker

Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.

Publisher description, verbatim

Last 7 dayson this actor

1rank move

Each one reaches followers by email the morning after.Follow this actor

Key figures30 readings

Price / 1k$8.00per 1,000 results

Users / 30d0↓ 3 over 30 readings

Users, all time4↑ 1 over 30 readings

Runs / 30d28↓ 2 over 30 readings

Runs / user / mo—runs per monthly user

Recorded changes

2026-10-19searchKeyword rank moveleft top-10 for “chatgpt search” (#9 → #11)—on record
2026-10-16searchKeyword rank moveentered top-10 for “chatgpt search” (outside top 100 → #10)—on record
2026-10-15searchKeyword rank moveleft top-10 for “chatgpt search” (#10 → outside top 100)—on record

showing 3 of 6 in the last 30 days · followers get all 6 by email

History

30 readings since 2026-09-25

Users / 30d30 readings

Users, all time30 readings

Runs / 30d30 readings

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.