Sitemap best practices
XML sitemaps help search engines discover and prioritise URLs, but they become much more important on large sites where crawl focus and indexation control need stronger signals. This guide now absorbs the older sitemap explainer and focuses on what to include, how to segment large sitemap sets, and how to avoid feeding search engines low-value URLs.
What belongs in a sitemap
Include only canonical, indexable URLs that you genuinely want search engines to process. Do not include redirects, soft 404s, parameter variations, or low-value pages that dilute the signal. Large sites should segment sitemaps by page type or priority group so it is easier to monitor what is and is not being indexed.
- Include canonical and indexable URLs only
- Segment large sitemap sets by page group
- Exclude low-value or broken URLs
Sitemaps as indexation control
Sitemaps do not force indexing, but they do help clarify which URLs deserve attention. On large sites, they become a practical indexation control layer alongside internal linking, canonicals, and crawl management. Use Search Console to compare submitted and indexed counts, then investigate any groups that consistently lag behind.
- Compare submitted and indexed counts
- Use sitemaps to support priority templates
- Treat sitemap errors as diagnosis signals