Robots Txt Audit

Audit robots.txt files for AI crawler access. Get an AI Readiness Score (0-100), analyze 61+ AI crawlers (ChatGPT, Claude, Perplexity, Gemini), detect syntax errors, security concerns, and get actionable recommendations. Batch audit multiple domains at once with optional subdomain scanning.

Publisher description, verbatim

Last 7 dayson this actor

No changes seen in the last 7 days.

The morning one happens, followers hear first.Follow this actor

Key figures30 readings

Price / 1k$5.00per 1,000 results

Users / 30d3↓ 1 over 30 readings

Users, all time12↑ 3 over 30 readings

Runs / 30d34↓ 5 over 30 readings

Runs / user / mo11.3runs per monthly user

Recorded changes

No price, README, schema or grade changes in the last 30 days · followers get the next one by email.

History

30 readings since 2026-08-27

Users / 30d30 readings

Users, all time30 readings

Runs / 30d30 readings

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported. Not indexed: too little has happened to this actor for us to have anything worth saying yet.