Tools / Sitemap URL Extractor & New Page Monitor

Sitemap URL Extractor & New Page Monitor

Pull every URL, lastmod and priority from any site's XML sitemaps (robots.txt discovery, indexes, .gz). Input: domains. Output (JSON/CSV): one row per item with domain, url, lastmod, changefreq, priority, sitemap, status, previousLastmod.

Run it on Apify Store →

What it's for

Track competitor product launches, landing pages, pricing pages and blog posts
Get alerts when a news site or blog publishes
SEO audits: count indexed URLs and find stale sections
Feed new URLs into another scraper

Example input

{
 "domains": [
  "apify.com"
 ]
}

Example output

{
  "domain": "www.sitemaps.org",
  "url": "https://www.sitemaps.org/",
  "lastmod": "2016-11-21",
  "changefreq": null,
  "priority": null,
  "sitemap": "https://www.sitemaps.org/sitemap.xml",
  "status": "current",
  "checkedAt": "2026-10-12T01:27:51.846Z"
}

Input reference

Field	Type	Notes
`domains` required	array	Sites to read. Sitemaps are found via robots.txt, then /sitemap.xml and /sitemap_index.xml.
`urlFilter`	string	Keep only URLs matching this, e.g. /blog/ or /products/.
`maxUrlsPerDomain`	integer	Stops reading sitemaps after this many URLs. Removed-page detection is skipped when truncated.
`maxSitemapsPerDomain`	integer	Safety cap on sitemap files fetched.
`monitorMode`	boolean	Marks rows as new, modified (lastmod changed) or removed. Schedule daily.
`outputMode`	string	changesOnly needs a previous run.
`stateStoreName`	string	Named key-value store holding the previous URL list.

Pricing

Pay per result. See the Pricing tab. Please respect each site's terms of use. Plus Apify's small per-run start fee. Apify's free plan includes monthly credit to try it.

How to run

Open the Store page and click Try for free.
Fill in the input (or paste the example JSON in the JSON tab).
Click Start, then export results as CSV, Excel or JSON, or call it via the Apify API.
Optional: add a Schedule and a webhook/Slack/email integration for ongoing monitoring.

Open Sitemap URL Extractor & New Page Monitor on Apify →