apifystats
Log in Start free
Actor/tinplatelabs

Site Discovery for AI Agents: robots, sitemaps, llms.txt

AI & agent tools

Per site: robots.txt rules with AI-crawler access (GPTBot, ClaudeBot, Google-Extended), every sitemap expanded into a deduplicated URL list (indexes, gzip, nested), and llms.txt. Plus an 'is URL X allowed for bot Y' check. Robust, priced per site.

Publisher description, verbatim
Last 7 dayson this actor
  • 1rank move
Each one reaches followers by email the morning after.Follow this actor
Key figures14 readings
Price / 1k$2.00per 1,000 site-analyzed
Users / 30d1→ 0 over 14 readings
Users, all time2→ 0 over 14 readings
Runs / 30d12↑ 11 over 14 readings
Runs / user / mo12.0runs per monthly user
Recorded changes
  • 2026-10-23searchKeyword rank moveleft top-10 for “scraper claude” (#9 → #12)—on record
showing 1 of 1 in the last 30 days · followers get the next one by email

History

14 readings since 2026-10-11
Users / 30d14 readings
10-11→ 010-24
Users, all time14 readings
10-11→ 010-24
Runs / 30d14 readings
10-11↑ 1110-24

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported. Not indexed: too little has happened to this actor for us to have anything worth saying yet.