Sitemap URL Extractor + Robots.txt & llms.txt Validator
Extract every URL from a site's sitemaps and check the sitemap files, robots.txt (rules for AI bots) and the structure of llms.txt. Streaming parser, flat memory; sites that cannot be read are free.
Publisher description, verbatimLast 7 dayson this actor
- 1price change
- 1other change
Each one reaches followers by email the morning after.Follow this actor
Price / 1k$0.40per 1,000 results
Users / 30d1→ 0 over 10 readings
Users, all time2→ 0 over 10 readings
Runs / 30d9↑ 8 over 10 readings
Runs / user / mo9.00runs per monthly user
- 2026-10-22pricePrice changed$0.5 → $0.4/1k—on record
- 2026-10-22contentREADME updated+0 characters+0characters
- 2026-10-15changeListed—on record
Follow this actor, compare it against its rivals, and get every overnight change in one morning report.
Publish it yourself? Claim your publisher page and its full history is yours free, forever.
Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.
Not indexed: too little has happened to this actor for us to have anything worth saying yet.