Tools / Sitemap URL Extractor: All Pages from Any Website
Sitemap URL Extractor: All Pages from Any Website
Get every URL a website publishes in its XML sitemaps. Input: websites. Output (JSON/CSV): one row per item with site, url, lastmod, changefreq, priority, imageCount, sitemap.
What it's for
- Feed a crawler or the RAG/Markdown tools exactly the pages you want
- Content inventory and 'what changed since' lists for SEO
- Find competitors' new product or blog pages by lastmod date
Example input
{
"websites": [
"apify.com",
"https://therealtour360.com",
"https://www.python.org/sitemap.xml",
"nonexistent-domain-zzq81.com"
],
"maxUrlsPerSite": 300
}Example output
{
"site": "https://apify.com",
"url": "https://apify.com/",
"lastmod": null,
"changefreq": null,
"priority": null,
"sitemap": "https://apify.com/sitemap/pages.xml",
"imageCount": 0
}Input reference
| Field | Type | Notes |
|---|---|---|
websites required | array | Domains, homepages or direct sitemap.xml links. |
discoverFromRobots | boolean | Discover sitemaps from robots.txt |
maxUrlsPerSite | integer | Max URLs per site |
includePatterns | array | e.g. /blog/ |
excludePatterns | array | e.g. /tag/ |
lastmodAfter | string | ISO date, e.g. 2026-01-01. Leave empty for all. |
includeImages | boolean | Include image URLs |
maxConcurrency | integer | Max concurrent sites |
Pricing
Pay per event: URL extracted $0.0002. Plus Apify's small per-run start fee. Apify's free plan includes monthly credit to try it.
How to run
- Open the Store page and click Try for free.
- Fill in the input (or paste the example JSON in the JSON tab).
- Click Start, then export results as CSV, Excel or JSON, or call it via the Apify API.
- Optional: add a Schedule and a webhook/Slack/email integration for ongoing monitoring.