XML Sitemaps Explained: Do You Really Need One?
An XML sitemap lists the pages you want search engines to find. Here's what belongs in one, when it matters most, and how to submit and monitor it.
Key takeaways
- An XML sitemap helps search engines discover your important URLs. It doesn't guarantee indexing.
- Include only canonical, indexable pages that return a 200 status.
- Sitemaps matter most for large sites, new sites with few links, and sites that publish often.
- Submit it in Search Console and reference it in robots.txt.
An XML sitemap is a file that lists the URLs on your website you want search engines to know about, optionally with information such as when each page was last modified. It’s a discovery aid: it helps Google find pages, but it doesn’t force Google to index or rank them.
Do you really need one?
Google says sitemaps are most useful if:
- Your site is large, so some pages might be missed
- Your site is new and has few external links
- You publish or update content often (news sites, blogs, stores)
- Your site has pages that are poorly linked internally
A small, well-linked site can be crawled fine without one, but a sitemap costs nothing and helps, so most sites should have one. WordPress creates one automatically at /wp-sitemap.xml, and SEO plugins generate their own.
What to include
- Canonical URLs only (not duplicates or parameter versions)
- Pages that return a 200 status (not redirects or 404s)
- Pages you want indexed (no noindex pages)
- Accurate
lastmoddates, updated only when content meaningfully changes
What to leave out
- Redirected URLs
- Noindexed pages, thank-you pages and internal search results
- Paginated or filtered URLs you don’t want indexed
- Staging or test URLs
Sitemap index files
A single sitemap can contain up to 50,000 URLs or 50 MB uncompressed. Larger sites split sitemaps by type (posts, pages, products) and list them in a sitemap index file. This also makes it easier to see which section has indexing problems.
News sitemaps
News publishers can use a Google News sitemap listing articles published in the last two days. (SEOaudit.pk publishes one at /news-sitemap.xml.)
How to submit and monitor
- Reference it in robots.txt:
Sitemap: https://www.example.com/sitemap.xml - In Search Console, go to Indexing → Sitemaps, enter the URL and submit.
- Check the status and the number of discovered URLs.
- Use the Page indexing report filtered by sitemap to see which submitted URLs aren’t indexed, and why.
Common errors
| Error | Fix |
|---|---|
| Couldn’t fetch | Check the URL, server response and robots.txt |
| URLs blocked by robots.txt | Remove them from the sitemap or unblock them |
| Redirected or 404 URLs listed | Regenerate the sitemap with only live, canonical URLs |
| Submitted URL marked noindex | Remove from the sitemap, or remove the noindex |
Sitemaps are one step in the technical SEO audit. To check indexing more broadly, read how to check if your website is indexed.