Pages Removed From Your Sitemap: What to Do Next

When pages are removed from a sitemap, first work out whether they vanished from the sitemap or from the website. Request the missing URLs directly: if they still return 200 and are still linked internally, they stay indexed and only lose crawl priority. If they return 404, 410 or a redirect, the sitemap is the symptom and the page is the problem. Deltio takes a daily snapshot of every sitemap you monitor and alerts you by email or Slack as soon as URLs are removed. 14-day free trial, from £20 a month.

Sitemaps are generated, not written. That is why they change without anyone deciding to change them: a deploy runs, a plugin updates, a product goes out of stock, and a batch of URLs quietly drops out of the file. Here is the triage, in order.

Step 1: check the pages, not the sitemap

Take five of the missing URLs and request them before you touch any settings.

• Status 200: the page is alive. It was excluded from the sitemap but still exists. Least serious case.
• Status 404 or 410: the page is gone. The sitemap simply stopped listing a dead URL, so your problem is upstream.
• Status 301 or 302: the URL changed. Check whether the destination is in the sitemap. If it is not, something broke.
• Still linked internally? Check the parent category, the menu, the related-posts block. No internal links and no sitemap entry means orphaned.
• Still indexed? Use URL Inspection or a site: query. Here is how to check if a page is indexed.

Step 2: the usual causes, in order of frequency

• A deploy or migration regenerated the sitemap. New generator, new rules: post types, taxonomies or paginated URLs get dropped because the config never carried over.
• The SEO plugin was reconfigured. Someone switched a content type off in Yoast or Rank Math. One checkbox, hundreds of URLs.
• Out-of-stock products are excluded automatically. Most e-commerce platforms drop unavailable products, so seasonal stock moves URLs in and out.
• Pages were set to draft or private. A tidy-up in the CMS, and the sitemap follows within a day.
• A noindex was applied. Good generators exclude noindex pages, so a removal is often the first visible symptom of an accidental one.
• URLs changed without redirects. New slugs, a new structure, a trailing-slash rule: the old URLs vanish and the new ones take their place.

Step 3: what it really means

A sitemap is a discovery hint, not the index. A page missing from the sitemap but still linked internally stays indexed and keeps ranking. What it loses is crawl priority: it gets revisited less often, so updates take longer to register. For new or deep pages the loss is real, and a product four clicks from the homepage can wait weeks to be discovered.

The real value is diagnostic. A removal rarely hurts on its own, but it is the cheapest early warning that something changed on the site: a noindex, a deletion, a broken template. Smoke alarm, not fire.

Step 4: what to do today

• Restore or redirect. Republish the page, or 301 it to the closest relevant page rather than leaving a 404.
• Remove the exclusion. Turn the post type back on, clear the noindex, fix the generator rule that dropped the URLs.
• Regenerate and resubmit. Purge the sitemap cache, open the file to confirm the URLs are back, then resubmit it in Search Console.
• Recheck indexation. Removal plus a noindex plus a lost internal link is how pages quietly leave the index.
• Re-scan titles, canonicals and H1s. A deploy that broke the sitemap probably broke other things on the same templates.

Only canonical, indexable, 200 URLs belong in the file. Our guide to XML sitemap best practices covers the rules worth enforcing.

How Deltio does it

Sitemap changes are not hard to fix. They are hard to see. The answer is a daily diff, and that is what Deltio runs: it snapshots every sitemap you add, nested sitemap indexes included, and compares it with the previous one. URLs added, URLs removed and lastmod values changed all show up, removals trigger an alert by email or Slack with a link to the diff, and the last 7 snapshots are kept so you can see exactly when the URLs went.

Because removals rarely travel alone, Deltio also scans the pages themselves: title, meta description, H1, canonical, lang and hreflang, comparing consecutive scans to surface what changed. Add robots.txt monitoring, HTTP checks every 10 minutes and SSL and domain expiry alerts, and you get the habit we describe in how to monitor client websites for changes.

Start with one site

Add a site, point Deltio at its sitemap, and the first snapshot lands straight away. From tomorrow, every removed URL becomes an alert instead of a surprise. Plans start at £24 a month (£20 if you pay annually), with a 14-day free trial.