Robots.txt & XML Sitemap Discrepancy Checker

Audit robots.txt directives (Disallow, Allow, Crawl-delay) against XML Sitemap URLs. Identifies blocked sitemap URLs, missing sitemaps, and indexing discrepancies.

Publisher description, verbatim

Last 7 dayson this actor

No changes seen in the last 7 days.

The morning one happens, followers hear first.Follow this actor

Key figures20 readings

Price / 1k$1.00per 1,000 item-scraped

Users / 30d1↑ 1 over 20 readings

Users, all time2↑ 1 over 20 readings

Runs / 30d17↑ 16 over 19 readings

Runs / user / mo17.0runs per monthly user

Recorded changes

2026-10-16changeTitle changed—on record
2026-10-16contentDescription changed—on record
2026-10-08changeTitle changed—on record

showing 3 of 5 in the last 30 days · followers get all 5 by email

History

20 readings since 2026-10-05

Users / 30d20 readings

Users, all time20 readings

Runs / 30d19 readings

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.