How to Monitor Sitemap Changes Automatically
To monitor sitemap changes, download sitemap.xml on a fixed schedule, store every copy, and diff each new snapshot against the previous one. Three things matter: URLs added, URLs removed, and lastmod values that changed. You can do it by hand with curl, sort and diff, but Search Console never alerts you, and nobody runs a manual diff across 20 client sites every morning. Deltio takes a daily sitemap snapshot, diffs it automatically, follows nested sitemap index files and pings you on Slack or email when something moves. From £20 a month, with a 14-day free trial.
A sitemap is the only file on a site that states, in plain text, which pages the CMS thinks should exist. That makes it the cheapest early warning system in SEO. When a migration silently drops 400 product pages, the sitemap knows days before your rankings do. The problem is that nobody looks at it. It gets checked once at launch, then never again, until traffic falls off a cliff and somebody hunts for the cause.
What actually changes in a sitemap
- URLs added: either someone published something (fine) or something is generating junk: tag archives, paginated filters, attachment pages, staging URLs in production. A plugin update that switches on product attribute pages can add thousands of thin URLs overnight, and you pay for that crawl budget.
- URLs removed: the dangerous one. A URL leaving the sitemap is a page the CMS no longer considers publishable: deleted, unpublished, set to
noindex, or lost in a migration. Google keeps it indexed for a while, which is exactly why rankings will not tell you for weeks. lastmodchanging in bulk: if every URL suddenly reports today's date, a re-deploy rewrote the timestamps. You are telling Google the whole site changed, inviting a full re-crawl and burning the one signallastmodshould carry. Worse, it hides the pages that genuinely did change.
Writing the file correctly is a separate job: see XML sitemap best practices. This piece is about watching it after it ships.
The manual methods, and where they break
The classic approach is a two-line diff:
curl -s https://example.com/sitemap.xml \
| grep -o '<loc>[^<]*' | cut -c6- | sort > today.txt
diff yesterday.txt today.txt
It works, for one site, once. Here is where it stops being enough:
- Search Console gives a count, not a diff, and never alerts. The Sitemaps report shows how many URLs were discovered, days late. It never says which ones disappeared, and it waits for you to log in.
- Nobody keeps the cron running. A script on your laptop survives about three weeks. Across 20 client sites, a daily manual diff does not happen. Ever.
- Sitemap index files break the one-liner. Most real sites serve a
sitemap_index.xmlpointing atpost-sitemap.xml,page-sitemap.xml,product-sitemap.xml. Yourgrepreturns child sitemaps, not pages, so you monitor nothing. - A URL diff is not a page diff. A fresh
lastmodon/pricing/does not tell you the title tag got wiped in the same deploy.
What good sitemap monitoring looks like
- A snapshot on a fixed schedule. Daily, not weekly. Weekly and you find out too late.
- An automatic diff, with history. One snapshot is a photo. A run of them is evidence for the client who swears nothing changed.
- Full sitemap index support. Follow the index, fetch every child sitemap, treat the result as one URL set.
- Alerts on events, not noise. Ten new blog posts are not an incident. Ninety URLs vanishing is.
- A re-scan of what changed. Do the changed pages still have a title, an H1 and a sane canonical?
How Deltio monitors sitemap changes
Deltio takes a daily snapshot of your sitemap and compares it with the previous one. You get the diff: URLs added, URLs removed, lastmod changed, each listed explicitly instead of summed into a number. Nested sitemap index files are followed and flattened, so a WordPress or Shopify index is handled like a flat file. The last 7 snapshots are kept, so you can see when the drop actually started.
Alerts go to email and Slack, in your language, with a link to the dashboard. And because a changed URL usually means a changed page, Deltio re-scans the affected pages with its SEO checks: title, meta description, H1, canonical, lang and hreflang, compared against the previous scan. That turns "the sitemap changed" into "12 pages changed and 3 lost their meta description". It pairs with SEO change alerts and the wider job of monitoring client websites for changes.
Get it watching one site tonight
Pick the client site that worries you most: the plugin-happy CMS, or the one mid-migration. Add its sitemap, let Deltio take the first snapshot, and tomorrow you have a diff instead of a hunch. Plans start at £24 a month, £20 paid annually, with a 14-day free trial.
Frequently asked questions
- How do I monitor sitemap changes?
- Fetch your sitemap.xml on a fixed schedule, save each copy, and diff every new snapshot against the previous one. You are looking for URLs added, URLs removed and lastmod values that changed. Doing it manually with curl and diff works for one site; across a portfolio you need a tool that snapshots daily and alerts you automatically.
- Does Google Search Console alert me when my sitemap changes?
- No. The Sitemaps report shows how many URLs Google discovered, and the figure updates days after the fact. It never tells you which specific URLs were removed, and it sends no notification. You have to log in and notice, which is why sitemap drops usually go unspotted for weeks.
- Why does it matter when URLs are removed from a sitemap?
- A URL leaving the sitemap means the CMS no longer considers that page publishable: deleted, unpublished, set to noindex, or lost in a migration. Google keeps the page indexed for a while, so rankings will not warn you. The sitemap is the earliest signal you get.
- What does it mean if lastmod changes on every URL at once?
- It usually means a re-deploy rewrote the timestamps rather than a real content update. Google reads it as the whole site having changed, which invites a full re-crawl and destroys the value of lastmod as a signal. It also hides the pages that genuinely were edited.
- Does Deltio support nested sitemap index files?
- Yes. Deltio follows a sitemap index, fetches every child sitemap it points to, and treats the result as a single URL set. WordPress and Shopify style indexes are handled the same way as a flat sitemap.xml.
- How much does sitemap monitoring cost with Deltio?
- Sitemap monitoring is included in every plan. Starter is £24 a month, or £20 a month billed annually, with Professional at £49 and Enterprise at £119. Every plan comes with a 14-day free trial.