Ds Moz Sitemap
Lists a website's important pages and related resources, providing search engines with crawl hints like last updated dates and alternate language versions.
If you have ever submitted a sitemap and still had pages not indexed, you already know it is a crawl hint, not a guarantee.
Key points
- Submit your sitemap in Search Console and reference it in your robots.txt file.
- Use absolute canonical URLs only; avoid non-canonical, redirected, or parameter-heavy URLs.
- Check Search Console's Sitemaps report for processing errors after submission.
- A sitemap does not guarantee indexing; it only helps discovery and crawl efficiency.
A sitemap that helped discovery but not indexing
A large e-commerce site with 10,000 product pages submitted a sitemap listing canonical URLs. Within a week, Google crawled 8,000 pages, but 2,000 remained unindexed due to thin content. The sitemap successfully guided discovery but could not override content quality issues. The owner improved the thin pages and resubmitted the sitemap, leading to full indexing.
Three common mistakes with sitemaps
- Non-canonical URLs Including redirected or parameter-heavy URLs instead of the canonical version confuses crawlers, wastes crawl budget, and can cause indexing of non-preferred versions.
- Treating as ranking tool A sitemap is a crawl hint, not a ranking signal. It does not boost rankings or guarantee indexing.
- Ignoring errors After submission, check Search Console for processing errors; unnoticed errors such as inaccessible URLs or format problems can prevent Google from reading your sitemap and reduce crawl efficiency.
Three ways sitemaps improve crawl efficiency
- Discovery of new pages Sitemaps help search engines find pages that might not be discovered through internal links, especially on large or new sites.
- Freshness signals By including last modified dates, you signal which pages have changed, helping crawlers prioritise recrawls and ensuring that fresh content is indexed more quickly.
- Alternate language versions Sitemaps can specify hreflang annotations for multilingual sites, helping search engines serve the correct language version to users and avoiding duplicate content issues across languages.
Common questions
What is a sitemap?
A sitemap is a file that lists a website's important pages and provides crawl hints to search engines.
How do I make a sitemap?
Most CMS platforms generate sitemaps automatically. You can also use online tools or plugins to create an XML sitemap.
How do I download a sitemap?
If your site has a sitemap, you can download it by visiting yourdomain.com/sitemap.xml or checking your CMS settings.
Sources
- Google Search Central: What Is a Sitemap Official Google documentation on sitemap basics and best practices.
- Google Search Console Help: Sitemap Google's help article on submitting and managing sitemaps in Search Console.
- Moz: What is an XML Sitemap? Moz's beginner-friendly guide to XML sitemaps and their role in SEO.