Sitemap Scraper: Every URL on Any Site

Get every URL a website publishes, from a bare domain. Finds the sitemap through robots.txt or the usual paths, follows nested sitemap index files to any depth, unpacks .xml.gz, and returns each URL with lastmod, changefreq and priority. Filter by path regex or by what changed since a date.

Publisher description, verbatim
Last 7 dayson this actor
  • 4rank moves
Each one reaches followers by email the morning after.Follow this actor
Key figures30 readings
Price / 1k$1.50per 1,000 results
Users / 30d1→ 0 over 30 readings
Users, all time2→ 0 over 30 readings
Runs / 30d29↑ 19 over 30 readings
Runs / user / mo29.0runs per monthly user
Users / 30d30 readings
08-10→ 009-08
Store search presence
1top-10 keywords

best #10 for “any site”

  • any site#10
re-crawled daily

Recorded changes

showing 3 of 9 in the last 30 days · followers get all 9 by email
  • 2026-09-07searchKeyword rank moveentered top-10 for “any site” (#12 → #10)on record
  • 2026-09-06searchKeyword rank moveleft top-10 for “any site” (#9 → #12)on record
  • 2026-09-05searchKeyword rank moveentered top-10 for “any site” (#11 → #9)on record

Follow this actor, compare it against its rivals, and get every overnight change in one morning report. Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Publish this actor? Claim the page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.