Sitemap & robots.txt Extractor - All Site URLs
Extract every URL a website publishes. Reads robots.txt, discovers sitemaps, walks sitemap indexes recursively and returns URL, path, last modified date, change frequency, priority and hreflang. Optional robots.txt rule parsing. For SEO audits, content inventory and migration planning.
Publisher description, verbatimLast 7 dayson this actor
No changes seen in the last 7 days.
The morning one happens, followers hear first.Follow this actor
Price / 1k$1.00per 1,000 results
Users / 30d1↑ 1 over 9 readings
Users, all time2↑ 1 over 9 readings
Runs / 30d7↑ 6 over 8 readings
Runs / user / mo7.00runs per monthly user
- 2026-09-17changeListed—on record
Follow this actor, compare it against its rivals, and get every overnight change in one morning report.
Publish it yourself? Claim your publisher page and its full history is yours free, forever.
Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.
Not indexed: too little has happened to this actor for us to have anything worth saying yet.